I've got a dataset with ~42,000 rows in it and I am trying to lookup a value using the following formula.
from_dataset("Time Distribution", "hour", location_id: location_id, year: year, month: month, week: week, dow: dow)
Fairly obvious what this does, but fundamentally I'm shaping a time series distribution for locations based on the year, month, week and day of week (dow).
If I use this, I cannot generate ANY data. Even if I only ask to generate ONE row, this errors out and I need to generate around 5000 rows.
Additionally, it seems that when I call generate in my API handler, I can't say generate 800 + rand(201) to generate between 800 and 1,000 rows. That causes a generic "Something went wrong" / 500 response from the server.