I have a large Json with around 175,000 properties each with two strings giving around 4 million characters. At the moment I have been writing them as characters to two different arrays which i index with comma’s that i use to separate them when i read from the array back intro separate strings. This process takes 5-10 seconds to do and is very slow compared to reading the double properties from the Json which takes under a second. I understand this is a very bad way to do it but i am just trying to learn TileDB and just did this to get some results.
So my question is what is the best way i can represent this information in a TileDB array? It seems that it must use a sparse array and can only be written unordered. As when i read the information i have to reassemble the characters as they are not in order which slows down reading a lot as well. Is it possible to keep the characters indexed somehow so that i can look for say string 55 in the array which will read all the characters associated with that string only?