Stephen Wolfram explores the broader picture of what's going on inside ChatGPT and why it produces meaningful text. Discusses models, training neural nets, embeddings, tokens, transformers, language syntax. Comprehensive, clear, long.

A guide to the useful things one can do with LLMs.To write stuff: nothing comes "even close to GPT-4... access at Bing for free or ... subscription to ChatGPT... GPT-3.5 also good and much faster". Some tips: "Getting good writing out of ChatGPT takes some practice"Paste in your text and ask ChatGPT to improve it, suggest &q;…

"build a chatbot capable of extracting any kind of information from a set of documents ... your own Document Assistant from scratch, using GPT-3 and Langchain"Good explainer of using embeddings to get around token limits "using LangChain, which is an open-source library designed to simplify the utilization of LLMs with Chain of Thou…

"leverage ChatGPT to answer natural language questions on a variety of text repositories... [via a ]combination of embeddings, vector search, and prompt engineering...Embeddings are mathematical representations of words, phrases, or even entire documents as vectors ... sequences [with] similar meaning are “close together” in a high-dimensiona…

"“Document Search Chatbot” ... field common questions (FAQ’s) based on the content of several documents.... Azure Search to extract and rank key highlights from a set of text documents based on a user query. This user query and Azure Search results are then passed to OpenAI to be interpreted and formatted into a chat based response..."Wh…

How to set up BLOOM on your own cloud."BigScience Large Open-science Open-access Multilingual Language Model:free transformer-based language model created by 1000 researcherstrained on about 1,6 TB pre-processed multilingual text.biggest BLOOM model in parameters is 176B = ~GPT-3 scalesmaller models available: 7b, 3b, 1b7Needs 360 GB of RAM ,…

"how you can run state-of-the-art large language models on your local computer" using two models which are "comparable or even outperform GPT [but can] run on your local computer... released under a non-commercial license":"dalai library" - allows us to run LLaMA & Alpaca, provides an API "LLaMA: foundationa…

" a step-by-step guide for building a document Q&A chatbot in an efficient way with llama-index and GPT API... ask the bot in natural language about your own documents/data... [see it] retrieving info from the documents and generating a response [1]... customer support, synthesizing user research, your personal knowledge management"K…