S3 Files First Impressions
s3 files was surprisingly easy to get setup - take an exisitng bucket enable fs in the UI and mount it (not much sg or policy setup headache required), a big upside is for local dev we can just have o
Latest articles
Giving access to a single bigquery dataset
Sometimes you want to share a single dataset with a third party. Here's how you can do that. First add them in the IAM with role Bigquery Job User: Then go to the bigquery dataset and hit sharing and share with just that user. You should test with...
Graphing Time series in MySQL
We'll generate a series of sensor recordings from raw sensor readings that can come in at arbitrary times: Begin by creating a table of recordings: CREATE TABLE sensor_readings ( id int not null auto_increment, name varchar(255) not null, ...
Unlocking OLAP in MySQL
This is a preliminary draft - see https://www.avaitla16.com/how-i-write Historically you've needed an OLTP (online transaction processing system - like mysql, postgres, sqlserver, oracle) database to run transactions on and then an ETL to an OLAP sy...
Application Time Periods in Postgres
This is a preliminary draft - see https://www.avaitla16.com/how-i-write I have been dealing with application time periods quite a bit recently. To learn more I was speaking with Paul Jungwirth on his good progress on Application periods in postgres. ...
Recording Record version ID in MySQL
It can be useful to record the update count of a row. This way you can know how many times a row has been updated. This is even more useful if you have a binlog cdc pipeline and are tracking the order of updates and need to ledger them in a history t...
Document Versioning and DELETE FROM Recovery in MariaDB
Let's build a place for authors to ink their great novels. Writing takes time and we'd want to ensure an authors could view prior versions and drafts. We can manually support this with audit tables or other ledgering, but MariaDB system versioned tab...
Doing Query and Cost Analysis for BQ in Metabase
An idea suggested by the datafold team to better understand costly queries was just plugin information schema into metabase. This is possible but a bit tricky. You need to add a true dataset and not information schema directly otherwise you'll get er...
AS OF SQL in Dolt
Dolt is a unique product that can version your data. There are many features it includes but one is the 'AS OF' query to look at a certain past point in time with unlimited time travel (there are other databases that can support this as well - in par...