RSSAmplifier

Blog

ai.moda's blog

You aren't supposed to be here.

ghost.ai.modaRSS feed ↗15 posts

Latest posts

IP + Domain, One Cert: Let's Encrypt Short-Lived Certificates

Learn how to issue one short-lived Let's Encrypt cert that covers your domain and IPs, then load it in Caddy via acme.sh for HTTP/3-ready TLS.

OpenAI Internals: Structured Outputs to System Prompts

Curious how OpenAI converts your schema into a hidden system message? We'll show you how it works!

Optimizing Claude MCP Server Usage: Leveraging Prompt Caching

Multiple MCP server calls are billed like separate API requests, quickly inflating your token count. Discover how prompt caching - an undocumented feature for MCP servers - dramatically reduces these costs with minimal code changes.

Sora Pricing on Azure OpenAI

It's not great.

OpenAI Internals: Remote MCP to System Prompts

Ever wonder how OpenAI handle remote MCP servers? Wonder no more!

Claude Code Internals: Intercepting Requests (MITM)

Want to see what Claude Code is doing? We'll show you how to check!

Claude Code Internals: Web Search

Ever wonder how Claude Code searches the web? Wonder no more!

Google Vertex AI Model Availability (Updated Hourly)

Live list of all models on Google Cloud Vertex AI.

Amazon Bedrock Model Availability (Updated Hourly)

Live list of all models on Amazon Bedrock.

Where are my Cloudflare Email Workers running?

A simple solution to figure out what PoP your Cloudflare Email Workers are running in.

Automating Aurora DSQL and Cloudflare Hyperdrive Integration with Workers

Learn how to automatically manage rotating credentials and IAM tokens for your PostgreSQL databases using Cloudflare Workers. Perfect for teams using Aurora DSQL or any database that requires periodic credential updates with Hyperdrive.

Automatic Anthropic to Vertex AI Failover using Cloudflare AI Gateway

Getting the dreaded overloaded_error when using claude-3-5-sonnet-20241022? Use Cloudflare AI Gateway to automatically failover to Vertex AI!

Identifying Anthropic Claude Errors on Amazon Bedrock

Learn how to identify and troubleshoot errors with Claude 3.5 Sonnet on Amazon Bedrock using CloudWatch and CloudTrail.

Chaining OpenAI Models: Better and Faster

This blog explores combining AI models for a efficient, accurate, and cost-effective solution. We chain responses from a larger model (GPT-4o) to a smaller one (GPT-4o mini) to convert complex outputs into structured JSON. A Python script demonstrates this step-by-step process.

Optimizing Token Usage in OpenAI's JSON Mode with Stop Sequences

By strategically setting stop conditions, you can cut down on unnecessary tokens, saving 20% on your output in our example. Learn how to implement this technique and even recover full tokens with logprobs.