AVAnil Vaitlainavaitla16.hashnode.dev·Apr 8 · 2 min readS3 Files First Impressionss3 files was surprisingly easy to get setup - take an exisitng bucket enable fs in the UI and mount it (not much sg or policy setup headache required), a big upside is for local dev we can just have o00
AVAnil Vaitlainavaitla16.hashnode.dev·May 18, 2023 · 1 min readGiving access to a single bigquery datasetSometimes you want to share a single dataset with a third party. Here's how you can do that. First add them in the IAM with role Bigquery Job User: Then go to the bigquery dataset and hit sharing and share with just that user. You should test with...00
AVAnil Vaitlainnocd.hashnode.dev·Apr 13, 2023 · 3 min readGet your bigquery data into rillYou need a CSV or Parquet file to load into Rill (https://docs.rilldata.com/using-rill/import-data). Here are steps and caveats you can follow to get a dataset in Bigquery into that format and processed with Rill. Much of the guidance here is from th...00
AVAnil Vaitlainavaitla16.hashnode.dev·Feb 21, 2023 · 6 min readGraphing Time series in MySQLWe'll generate a series of sensor recordings from raw sensor readings that can come in at arbitrary times: Begin by creating a table of recordings: CREATE TABLE sensor_readings ( id int not null auto_increment, name varchar(255) not null, ...00
AVAnil Vaitlainnocd.hashnode.dev·Apr 16, 2022 · 2 min readGenerated columns in MySQLSometimes a table just needs to capture JSON input and store it. An example is the greenhouse api (https://developers.greenhouse.io/webhooks.html). In order to track stage changes you need to listen to webhook events which arrive as json blobs. Rathe...00
