Search for a command to run...
s3 files was surprisingly easy to get setup - take an exisitng bucket enable fs in the UI and mount it (not much sg or policy setup headache required), a big upside is for local dev we can just have o
Sometimes you want to share a single dataset with a third party. Here's how you can do that. First add them in the IAM with role Bigquery Job User: Then go to the bigquery dataset and hit sharing and share with just that user. You should test with...
We'll generate a series of sensor recordings from raw sensor readings that can come in at arbitrary times: Begin by creating a table of recordings: CREATE TABLE sensor_readings ( id int not null auto_increment, name varchar(255) not null, ...
This is a preliminary draft - see https://www.avaitla16.com/how-i-write Historically you've needed an OLTP (online transaction processing system - like mysql, postgres, sqlserver, oracle) database to run transactions on and then an ETL to an OLAP sy...
This is a preliminary draft - see https://www.avaitla16.com/how-i-write I have been dealing with application time periods quite a bit recently. To learn more I was speaking with Paul Jungwirth on his good progress on Application periods in postgres. ...
It can be useful to record the update count of a row. This way you can know how many times a row has been updated. This is even more useful if you have a binlog cdc pipeline and are tracking the order of updates and need to ledger them in a history t...
Let's build a place for authors to ink their great novels. Writing takes time and we'd want to ensure an authors could view prior versions and drafts. We can manually support this with audit tables or other ledgering, but MariaDB system versioned tab...
An idea suggested by the datafold team to better understand costly queries was just plugin information schema into metabase. This is possible but a bit tricky. You need to add a true dataset and not information schema directly otherwise you'll get er...
Dolt is a unique product that can version your data. There are many features it includes but one is the 'AS OF' query to look at a certain past point in time with unlimited time travel (there are other databases that can support this as well - in par...