Speaker: Vanya Seth
For more see the table of contents
ScriptingTheKernel – eBPF
- Cartoon – need a year to add something to the kernel, then have to wait until Linux distro ships. Five years later available and requirements have changed
- eBPF – verifies bytecode and then runs in kernel
- kernel makes sure you are absolutely safe
- “superpower of linux”
- Cilium – networking/clusters, service mesh
AI Team Assistants
- First reaction is usually coding assistants
- Software development is a team sport
- Not just about increasing coding throughput
- Need to boost whole supply chain/delivery cycle and include all roles.
- Need to think about how AI can help a cross functional team
- https://www.thoughtworks.com/en-us/what-we-do/ai/ai-enabled-software-engineering/Haiven_team_assistant
Zero Trust Security for CI/CD
- Zero trust is not a new trend
- Need to think about CI/CD in same way as customer facing systems
- Pipelines need access to critical data like code, credentials/secrets
- Limit runner privileges
- Short lived tokens
Using Gen AI to understand legacy codebases
- A lot to understand to convert to a new tech stack – business logic, dependencies, etc
- Document understanding
- Ask gen AI to explain code, but it’s not enough
- Can use RAG on codebase, but still not enough
- Graphs + RAG is more powerful.
SecretsOps
- Where do you put your seed secrets? The one neeeded to start everything. HOw do you bootstrap the bootstrapper?
- Where store secrets overall?
On device LLM Inference
- Need integrated into life
- Wrapped into devices use ex: fridge [I don’t want my fridge to be smart!]
- Quantization – compress parameters so can run on phone/raspberry pi
- Small language models – fit for purpose models have 1-7 billlion params or less. Save memory
- WebLLM – In browser inference engine
My take
Excellent keynote. New things and new ways to think about non-new things.