man this guy @bmdavis419 is slowly turning me to a svelte guy

Made a video on modern infra stuff, ended up going down a lot of rabbit holes: - severless - dbs - ai workloads - pricing models - app performance - the $5 VPS Really happy with this one: piped.video/1nk-BEo5WAY

Yea obviously it's a small workload, but still the combo of metal + bun + internal networking is insane (none of these endpoints are being cached) Project in the vid is also OSS if u want to see it, it's just sveltekit + drizzle + mysql + bun: github.com/bmdavis419/r8y-v3

Moved some internal tools over to @Railway mostly just cause I thought it would be fun and wanted a long running server, did not expect it to be this absurdly fast This vid is not sped up at all, it's just a SvelteKit project, using bun, & mysql over railway's internal network

Random thing I made that went too far because I hated how bad the experience of consuming an AI stream was: - no type saftey (esp on tool calls) - durable streams are hard - don't like the useChat api - manually parsing streams sucks - I wanted an "onChunk" with typesafety on the client to do crazy custom UIs for AI agent streams Fully working in SvelteKit TanStack Start and React Native/Expo support coming soon... github.com/bmdavis419/river

The end result is now you can start a durable stream in the background server side and just grab it's results whenever. Gonna be so good once I finish this in a bit (need to update all the providers and do the caller implementation lol)

The best part of working on River has been actually getting good at the insane type system TS has Just wrote this type entirely off the top of my head to get full type safety on a server side caller using the builder pattern to get proper type narrowing The generics system in TS is genuinely incredible, you can do so much insane stuff with this (including heavily lie to typescript with crazy proxy bullshit which I'm doing a lot)

first commit on the move to monorepo + break into packages + adding redis support + api rewrite was 7 hours ago lol I need to go to bed

Future plans: - real documentation - good cursor rules - automatic setup for river with a prompt to cursor agent - tanstack start support - expo/react native support - s2 provider (for durable streams) - more real world examples Goal is to get this done by end of November 🫡

Durable streams with redis: - include the redis provider when you make a river stream - provide your redis client, a wait until function to run it even after the request ends, and a key to group the streams - the client will now get a "resume key" which you can use to resume the stream by simply calling .resume and passing it in

New package setup: - core: all the shared core parts of River - redis provider: support for durable streams with redis - sveltekit: client/server side functions to use sveltekit with River This will make it really easy to add support for more frameworks and providers in the future

Just published a much better version of River: - durable streams with resuming works out of the box with any redis provider - migrated to a monorepo - cleaned up the apis & error handling - new durable streams example github.com/bmdavis419/river-…

Apparently mono repos are actually good now and I will probably be using them a lot Idk if I got smarter or if they got fixed but bun + turborepo is really easy to use atm and feels great (this was hell the last time I tried ~year ago)

Turned my current feelings on llms into a video: piped.video/FSdD7gyfgkY TL;DR: fast models that take direction well >>>>

Great video on TanStack Start by @bmdavis419 I can't wait for Tanner to finish middleware so I can show the TanStack version of single flight mutations. A tad more complexity, which you can stick in Middleware and forget about—but much more power and flexibility🚀 Link below👇

*wins the react world (you can pry my sveltekit from my cold dead hands)

Turned my SvelteKit vs TanStack Start comparison into a video TL;DR: TanStack Start is really really good, I hope it wins...

Worked a hard security shift with @bmdavis419 this Halloween