Dataset with mixed shapes

[Mtrl_Scientist]

Hi @julia,

@julia

what you are asking for is the ability to read from multiple arrays that share similar dimension with a single query?

Yes. The amount_base & amount_quote variables would be read from a dense 2D array, whereas the remaining variables would be read from a dense 1D array that has the same labels for the date dimension.

@julia

In your use cases are the extra arrays always one dimensional, or do you want to be able to handle a mix of different arrays together?

They don’t always have to be one-dimensional, no. Yes, I’d like to be able to handle a mix of different arrays. Come to think of it, it’d actually be very similar to what Kerchunk does. Maybe support for TileDB could be added?

Their examples show a more complex use-case with mixed-shape variables:

Here, the variables COH, inc, and lsmap depend on a different set of dimensions than the rest.