Infrastructure
LinkedIn Ads ➡️ Snowflake, with 3-legged OAuth in the middle
LinkedIn's Marketing API needs a browser to authorize. Scheduled pipelines don't have browsers. I store the refresh token in Snowflake.
Infrastructure
Posts related to hyperscalers (AWS, Azure, GCP) and pipelines (ELT/rETL, streaming, orchestration)
Infrastructure
I needed 2,110 municipal contacts. So I built a crawler that refuses to guess.
A public contact list sounds easy... until 2,110 websites, four languages, changing staff, and source evidence get involved. 😅
Infrastructure
Backing up Microsoft Planner with dlt and Azure Blob
Microsoft Planner has no native backup export, so I built a declarative dlt job that writes complete Graph snapshots to Azure Blob. 😎
Infrastructure
Your coding agent keeps a diary
Every opencode session leaves a trail in a local SQLite file. dlt turns it into analytics you actually read.
Infrastructure
dlt on a 4 GB pod: loading multi-GB datasets without the SIGKILL
Exit code 137 is dlt's way of saying "your RAM and I need to talk"
Lakehouse
MotherDuck Flights: pipelines an agent can fly, and why dlt belongs in the cockpit
MotherDuck shipped agent-native Python pipelines. The obvious thing to run inside one is dlt.
Infrastructure
OpenCode: a terminal coding agent without vendor lock‑in
Bring your own model, ditch the subscription.
Infrastructure
Perplexity Search as Code: letting models run the search
Why let a search engine guess what context your model needs? Perplexity's new Search as Code hands the reins to the agent.
Infrastructure
Triggering dltHub Pro pipelines from Snowflake
Moved a dlt pipeline off SPCS onto dltHub Pro. Still want Snowflake to push the button.
Infrastructure
dltHub Pro is here. So is my static-egress proxy VM.
How I kept IP‑locked Snowflake and Azure databases happy with a managed runtime that runs “wherever Python runs”
Infrastructure
On-prem AI agents: the signal in three announcements
Three vendors, one week, one direction: the cloud-only assumption for AI agents is cracking.
Infrastructure
Cortex Guardrails: one boolean, one job, four it doesn’t do
A single boolean on AI_COMPLETE, a Llama Guard 3 wrapper, and a hardcoded filter string. Useful, cheap, and nowhere near enough on its own.