This tutorial introduces a simple method to stream ChatGPT & GPT-4 responses. Streamed responses are served sooner to user side, which improve user experience. Introduction Streaming enables faster response to user query. The tutorial builds the necessary code to stream answers with ChatGPT API responses. The entire code is available in…

OpenAI released ChatGPT API with Chat Markup Language (ChatML)¹. Why you should get familiar with ChatML? — Introduction OpenAI’s announcement around ChatGPT & Whisper APIs included 10x price decrease with a curious detail related to ChatML¹. Developers had waited months to get access to ChatGPT API, but the news about ChatML was unexpected. However several developers reacted quickly with excitement to ChatML.

The updated Embedding model offers State-of-the-Art performance with a 4x longer context window. The new model is 90% cheaper. The smaller embedding dimensions reduce cost of storing them on vector databases. — Introduction OpenAI updated in December 2022 the Embedding model to text-embedding-ada-002. The new model offers: 90%-99.8% lower price 1/8th embeddings dimensions size reduces vector database costs

This tutorial guides step-by-step the new open source model Whisper! It is State-of-the-Art in the Speech Recognition! — OpenAI open-sourced Whisper model – the State-of-the-Art Speech recognition system. We tested it and got impressed! We took the latest RealPython episode for 1h 10 minutes. It took us 56 minutes with a basic CPU to convert the audio file into almost perfect text transcription with the smallest Whisper model.

In this tutorial, I integrate memory with GPT-4¹ for sophisticated applications with LLMs. Introduction In this tutorial, I will create a Large Language Model (LLM) application with an integrated memory. Internal memory improves factual accuracy. Humans write text with ability to ground knowledge from our memories, such as lived experiences. I…

Anthropic API offers early-access to cutting-edge Large Language Models (LLMs) by the highly-cited AI research team. Introduction Anthropic researchers have shaped the recent progress in AI research including: Scaling laws¹, GPT-3², CLIP³ and the RLHF⁴ and RLAIF⁵. The recent paper on AI safety⁶ is a must read. …

GPT-4 adapts automatically by evaluating, testing and improving the code. AutoGPTs automate entire cognitive workflows. — Introduction Prompts programs — such as AutoGPTs¹, adapt code in fully-autonomous manner. Large enterprises, such as Microsoft’s InferFix², are already using Autonomous Self-healing Software Systems³ to debug code internally. Self-healing workflows detect anomalies and diagnose errors automatically³.

Plugins enable third parties to build on top of ChatGPT platform with web browser & code generation included. Introduction OpenAI released today ChatGPT Plugins¹. The new feature includes built in web browser and code interpreter — I think impacting a heavy way on how internet is used today. …

OpenAI released new Whisper API for Speech to text. This solves the issue with the already released open source model by making run fast and without need of GPU. Introduction Today is busy day in OpenAI¹. The company not only released ChatGPT API, but as well Whisper API². …