{"id":1525,"date":"2023-06-09T07:48:36","date_gmt":"2023-06-09T07:48:36","guid":{"rendered":"https:\/\/geneea.com\/news\/?p=1525"},"modified":"2026-01-28T08:16:22","modified_gmt":"2026-01-28T08:16:22","slug":"geneeas-ai-spotlight-2","status":"publish","type":"post","link":"https:\/\/geneea.com\/news\/geneeas-ai-spotlight-2","title":{"rendered":"Geneea&#8217;s AI Spotlight #2"},"content":{"rendered":"\n<p>The second edition of our newsletter on Large Language Models is here. Below are summaries of papers and posts that captured our attention most during the last two weeks.&nbsp;<\/p>\n\n\n\n<p>Today, we look at&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>various practical challenges and how to address them,&nbsp;<\/li>\n\n\n\n<li>two new models: Google Palm 2 and Falcon,<\/li>\n\n\n\n<li>LIMA and its approach to fine-tuning, and&nbsp;<\/li>\n\n\n\n<li>we again mention several non-technical LLM topics.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Using LLMs in Practice<\/h2>\n\n\n\n<p><a href=\"https:\/\/www.honeycomb.io\/blog\/hard-stuff-nobody-talks-about-llm\">All the Hard Stuff Nobody Talks About when Building Products with LLMs<\/a>&nbsp;<strong>&nbsp;<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>An excellent post by Phillip Carter from Honeycomb.io about building a natural language search interface for events in Honeycomb.io\u2019s datastore<\/li>\n\n\n\n<li>It goes over all kinds of practical challenges of getting an LLM-based solution to production\u2014security, latency, prompt engineering, legal aspects, etc.&nbsp;<\/li>\n\n\n\n<li>It refers to the&nbsp;<a href=\"https:\/\/simonwillison.net\/2023\/May\/2\/prompt-injection-explained\/\">Prompt injection post<\/a>&nbsp;by Simon Willison. If you think SQL injection is fun, this is even better.<\/li>\n<\/ul>\n\n\n\n<p><strong>Guardrailing<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The new paradigm of tools talking in&nbsp;<strong>plain English<\/strong>&nbsp;is&nbsp;<strong>cool but challenging<\/strong>.&nbsp;<\/li>\n\n\n\n<li>In plain old Java, C#, \u2026 if a function has an&nbsp;<strong>integer return type<\/strong>, you know it will&nbsp;<strong>never return a string<\/strong>. Not usually or typically, never. With prompts, it is far from certain. Asking an LLM for a Yes\/No answer does&nbsp;<strong>not guarantee<\/strong>&nbsp;you will not see something more elaborate. This is where so-called guardrails can help.&nbsp;<\/li>\n\n\n\n<li><a href=\"https:\/\/github.com\/ShreyaR\/guardrails\">Guardrails<\/a>&nbsp;allow wrapping LLM calls with a layer&nbsp;<strong>validating the structure and content<\/strong>&nbsp;of the responses and taking&nbsp;<strong>corrective actions<\/strong>&nbsp;when the requirements are unmet.&nbsp;<\/li>\n\n\n\n<li><a href=\"https:\/\/github.com\/NVIDIA\/NeMo-Guardrails\">NeMo Guardrails<\/a>&nbsp;by NVIDIA is similar but designed specifically for dialog systems.&nbsp;<\/li>\n\n\n\n<li>Both libraries have built-in support for&nbsp;<strong>LangChain<\/strong>.<\/li>\n<\/ul>\n\n\n\n<p><strong>Llamaindex (<\/strong><a href=\"https:\/\/github.com\/jerryjliu\/llama_index\">Github<\/a><strong>)<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>If you like Langchain but are more interested in&nbsp;<strong>LLM-powered search<\/strong>&nbsp;than chatbots or agents, look at Llamaindex. We highly recommend it.<\/li>\n\n\n\n<li>It comes with&nbsp;<a href=\"https:\/\/llamahub.ai\/\">Llama Hub<\/a>, a repository of&nbsp;<strong>100+ data loaders<\/strong>&nbsp;(including those provided by Langchain).<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">LLM ZOO<\/h2>\n\n\n\n<p>This time, we look at two models: Google\u2019s Palm 2 and TTI\u2019s Falcon. The former because it cannot be ignored and the latter because it seems very promising for companies like ours that are running LLMs on their own.<\/p>\n\n\n\n<p><strong>Google Palm 2<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>On May 10, Google released a new version of Palm (see the&nbsp;<a href=\"https:\/\/blog.google\/technology\/ai\/google-palm-2-ai-large-language-model\/\">blog post<\/a>, a&nbsp;<a href=\"https:\/\/arxiv.org\/pdf\/2305.10403.pdf\">93-page paper<\/a>).&nbsp;<\/li>\n\n\n\n<li>There is no question that it is significantly better than the original Palm. But it is hard to compare to GPT4, Google reports results on benchmarks on which Palm outperforms GPT4, but&nbsp;<a href=\"https:\/\/twitter.com\/Laserfish2\/status\/1656385145140658176?s=20\">results on other benchmarks are less favorable<\/a>.<\/li>\n\n\n\n<li>Google focused on programming, common sense reasoning, math, and logic. But the really important feature for us is Palm\u2019s&nbsp;<strong>multilinguality<\/strong>: it was trained on&nbsp;<strong>100 human languages<\/strong>.&nbsp;<\/li>\n\n\n\n<li>Look at the examples in the paper: Palm explaining Japanese jokes, Persian proverbs, differences between European and Argentinian Spanish, etc.<\/li>\n\n\n\n<li>Palm is a family of models differing in size and use-case (currently, there is a general model and models focusing on the&nbsp;<a href=\"https:\/\/cloud.google.com\/blog\/topics\/healthcare-life-sciences\/sharing-google-med-palm-2-medical-large-language-model\">medical<\/a>&nbsp;and&nbsp;<a href=\"https:\/\/cloud.google.com\/blog\/products\/identity-security\/rsa-google-cloud-security-ai-workbench-generative-ai\">cyber security<\/a>&nbsp;domain).<\/li>\n\n\n\n<li>For obvious reasons, the model is not downloadable. It is available through&nbsp;<a href=\"https:\/\/developers.generativeai.google\/guide\/palm_api_overview\">API<\/a>&nbsp;and the new&nbsp;<a href=\"https:\/\/developers.googleblog.com\/2023\/05\/palm-api-and-makersuite-moving-into-public-preview.html\">Google Vertex platform<\/a>. The&nbsp;<a href=\"https:\/\/cloud.google.com\/vertex-ai\/pricing#generative_ai_models\">pricing<\/a>&nbsp;is comparable to OpenAI.<\/li>\n<\/ul>\n\n\n\n<p><strong>Falcon&nbsp;<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The Technology Innovation Institute (TII) in Abu Dhabi released&nbsp;<a href=\"https:\/\/falconllm.tii.ae\/\">Falcon<\/a>, a&nbsp;<a href=\"https:\/\/huggingface.co\/tiiuae\/falcon-7b\">7B<\/a>&nbsp;and&nbsp;<a href=\"https:\/\/huggingface.co\/tiiuae\/falcon-40b\">40B<\/a>-parameter LLM.&nbsp;<\/li>\n\n\n\n<li>According to the&nbsp;<a href=\"https:\/\/huggingface.co\/spaces\/HuggingFaceH4\/open_llm_leaderboard\">Open LLM leaderboard<\/a>, the 40B version&nbsp;<strong>outperforms all&nbsp;<\/strong>major&nbsp;<strong>open-source models<\/strong>, including LLaMA, Vicuna, Alpaca, RedPajama, etc.&nbsp;<\/li>\n\n\n\n<li>The models are trained mainly on English but also support German, Spanish, French, and to a certain extent seven other languages, including Czech.&nbsp;<\/li>\n\n\n\n<li>The license is very interesting: the model is&nbsp;<strong>free<\/strong>&nbsp;for research and&nbsp;<strong>commercial use<\/strong>&nbsp;for revenue under $1M.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Smart Fine-Tuning<\/h2>\n\n\n\n<p>In the previous&nbsp;<a href=\"https:\/\/www.linkedin.com\/pulse\/geneeas-ai-spotlight-1-geneea\/\">newsletter<\/a>, we mentioned Dromedary, a chatbot fine-tuned with only 300 seed examples that were automatically multiplied with the help of an LLM. Continuing in the same vein, we look at LIMA, another approach to minimizing the number of training examples during fine-tuning.<\/p>\n\n\n\n<p><strong>LIMA: Less Is More for Alignment<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The&nbsp;<a href=\"https:\/\/arxiv.org\/abs\/2305.11206\">paper<\/a>&nbsp;by researchers from Meta, CMU, USC, and Tel Aviv University argues that fine-tuning a good LLM can be done with a&nbsp;<strong>very small number of training examples<\/strong>&nbsp;because almost&nbsp;<strong>all knowledge is already present<\/strong>&nbsp;in the general LLM and fine-tuning mostly teaches the model how to draw from it and what style to use.<\/li>\n\n\n\n<li>They fine-tuned 65B LLaMa, Meta\u2019s LLM, for question answering using&nbsp;<strong>only 1000 carefully curated examples.&nbsp;<\/strong>They manually wrote 200 examples, and the rest was taken from StackExchange, WikiHow, and Reddit, but some examples were manually edited to achieve a unified \u2018assistant\u2019 style.&nbsp;<\/li>\n\n\n\n<li>In 43% of test cases, LIMA was better or tied with GPT-4. In 74% of cases, it was better or tied with Alpaca.&nbsp;<\/li>\n\n\n\n<li>Adding only 30 examples of multi-turn dialogue greatly improved performance on this kind of task.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Non-tech<\/h2>\n\n\n\n<p><strong>AI &amp; Naivety:<\/strong>&nbsp;<a href=\"https:\/\/www.bbc.com\/news\/world-us-canada-65735769\">A US lawyer submitted multiple precedents in a personal injury case<\/a>. Only after the defendant\u2019s lawyers complained they could not find some of the precedents, it came to light that they were all results of a \u201cconsultation\u201d with ChatGPT. The plaintiff\u2019s lawyer was unaware that the chatbot could say false things. He even asked the chatbot directly if they were real and was satisfied once the chatbot provided (bogus) references to legal databases. He promised the judge not to do something like that again.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p><em>\u201c[he] greatly regrets having utilized generative artificial intelligence to supplement the legal research performed herein and will never do so in the future without absolute verification of its authenticity.\u201d<\/em><\/p>\n<\/blockquote>\n\n\n\n<p><strong>AI &amp; Regulation:<\/strong>&nbsp;Sam Altman, CEO of OpenAI,&nbsp;<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>first&nbsp;<a href=\"https:\/\/time.com\/6280372\/sam-altman-chatgpt-regulate-ai\/\">asked for AI regulation<\/a>&nbsp;in a US Congress hearing,&nbsp;<\/li>\n\n\n\n<li>then&nbsp;<a href=\"https:\/\/www.reuters.com\/technology\/openai-may-leave-eu-if-regulations-bite-ceo-2023-05-24\/\">threatened to leave the EU over regulation<\/a>,&nbsp;<\/li>\n\n\n\n<li>then backtracked&nbsp;<a href=\"https:\/\/www.bbc.com\/news\/technology-65708114\">saying OpenAI has no such plans<\/a>.&nbsp;<\/li>\n<\/ul>\n\n\n\n<p>The&nbsp;<a href=\"https:\/\/www.europarl.europa.eu\/news\/en\/press-room\/20230505IPR84904\/ai-act-a-step-closer-to-the-first-rules-on-artificial-intelligence\">proposed EU AI Act<\/a>&nbsp;could require the disclosure of any copyrighted material a model was trained on.<\/p>\n\n\n\n<p><strong>AI &amp; News Media:&nbsp;<\/strong>NiemanLabs published a&nbsp;<a href=\"https:\/\/www.niemanlab.org\/2023\/05\/google-is-changing-up-search-what-does-that-mean-for-news-publishers\/?utm_source=pocket_reader\">great analysis<\/a>&nbsp;of the impact the coming&nbsp;<a href=\"https:\/\/blog.google\/products\/search\/search-generative-ai-tips\/\">AI-based Google search<\/a>&nbsp;will have on news media. They argue that it will significantly decrease traffic Google sends to publishers\u2019 sites because more people will get what they need from the Google search page\u2014another reason for society to figure out who will pay for the original content.<\/p>\n\n\n\n<p><strong>AI &amp; Society:<\/strong>&nbsp;Many media cited the&nbsp;<a href=\"https:\/\/www.pewresearch.org\/short-reads\/2023\/05\/24\/a-majority-of-americans-have-heard-of-chatgpt-but-few-have-tried-it-themselves\/\">Pew survey<\/a>&nbsp;that roughly 40% of Americans, 60% of Americans without a college degree, 50% of Blacks, only 20% of Asians, etc., have not heard about GPT. 14% have tried it. The differences in the numbers are still very interesting, but it is good to remember that they were collected six weeks ago.<\/p>\n\n\n\n<p>Please <a href=\"https:\/\/www.linkedin.com\/pulse\/geneeas-ai-spotlight-2-geneea%3FtrackingId=d1Ekjk7GRcQw6gZF2omt6w%253D%253D\/?trackingId=d1Ekjk7GRcQw6gZF2omt6w%3D%3D\">subscribe<\/a> and stay tuned for the next issue of Geneea\u2019s AI Spotlight newsletter!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The second edition of our newsletter on Large Language Models is here. Below are summaries of papers and posts that captured our attention most during the last two weeks.<br \/>\nToday, we look at:<br \/>\n\u2022 various practical challenges and how to address them,<br \/>\n\u2022 two new models: Google Palm 2 and Falcon,<br \/>\n\u2022 LIMA and its approach to fine-tuning, and<br \/>\n\u2022 we again mention several non-technical LLM topics.<\/p>\n","protected":false},"author":15,"featured_media":1602,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[378,374],"tags":[244,240,242],"class_list":["post-1525","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-large-language-models","category-newsletter","tag-ai","tag-generativeai","tag-newsletter"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Geneea&#039;s AI Spotlight #2 - Geneea News<\/title>\n<meta name=\"description\" content=\"LLM newsletter #2: practical problems and solutions, Google PaLM 2 and Falcon models, the LIMA model and debugging, plus several non-technical LLM topics.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/geneea.com\/news\/geneeas-ai-spotlight-2\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Geneea&#039;s AI Spotlight #2 - Geneea News\" \/>\n<meta property=\"og:description\" content=\"LLM newsletter #2: practical problems and solutions, Google PaLM 2 and Falcon models, the LIMA model and debugging, plus several non-technical LLM topics.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/geneea.com\/news\/geneeas-ai-spotlight-2\" \/>\n<meta property=\"og:site_name\" content=\"Geneea News\" \/>\n<meta property=\"article:published_time\" content=\"2023-06-09T07:48:36+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-01-28T08:16:22+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/geneea.com\/news\/wp-content\/uploads\/2023\/08\/newsletter2-robot-16x9done-done-done-1024x576.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"576\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Marcela Soukupova\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Marcela Soukupova\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/geneeas-ai-spotlight-2#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/geneeas-ai-spotlight-2\"},\"author\":{\"name\":\"Marcela Soukupova\",\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/#\\\/schema\\\/person\\\/69c8751a4c026723f4bac2e892f52cd8\"},\"headline\":\"Geneea&#8217;s AI Spotlight #2\",\"datePublished\":\"2023-06-09T07:48:36+00:00\",\"dateModified\":\"2026-01-28T08:16:22+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/geneeas-ai-spotlight-2\"},\"wordCount\":1160,\"publisher\":{\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/geneeas-ai-spotlight-2#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/geneea.com\\\/news\\\/wp-content\\\/uploads\\\/2023\\\/08\\\/newsletter2-robot-16x9done-done-done.png\",\"keywords\":[\"AI\",\"generativeAI\",\"newsletter\"],\"articleSection\":[\"Large language models\",\"Newsletter\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/geneeas-ai-spotlight-2\",\"url\":\"https:\\\/\\\/geneea.com\\\/news\\\/geneeas-ai-spotlight-2\",\"name\":\"Geneea's AI Spotlight #2 - Geneea News\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/geneeas-ai-spotlight-2#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/geneeas-ai-spotlight-2#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/geneea.com\\\/news\\\/wp-content\\\/uploads\\\/2023\\\/08\\\/newsletter2-robot-16x9done-done-done.png\",\"datePublished\":\"2023-06-09T07:48:36+00:00\",\"dateModified\":\"2026-01-28T08:16:22+00:00\",\"description\":\"LLM newsletter #2: practical problems and solutions, Google PaLM 2 and Falcon models, the LIMA model and debugging, plus several non-technical LLM topics.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/geneeas-ai-spotlight-2#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/geneea.com\\\/news\\\/geneeas-ai-spotlight-2\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/geneeas-ai-spotlight-2#primaryimage\",\"url\":\"https:\\\/\\\/geneea.com\\\/news\\\/wp-content\\\/uploads\\\/2023\\\/08\\\/newsletter2-robot-16x9done-done-done.png\",\"contentUrl\":\"https:\\\/\\\/geneea.com\\\/news\\\/wp-content\\\/uploads\\\/2023\\\/08\\\/newsletter2-robot-16x9done-done-done.png\",\"width\":1920,\"height\":1080},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/geneeas-ai-spotlight-2#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/geneea.com\\\/news\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Geneea&#8217;s AI Spotlight #2\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/#website\",\"url\":\"https:\\\/\\\/geneea.com\\\/news\\\/\",\"name\":\"Geneea News\",\"description\":\"Learn more about what&#039;s happening at Geneea: new NLP features, newest case studies, tutoring projects, conferences we attended, etc.\",\"publisher\":{\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/geneea.com\\\/news\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/#organization\",\"name\":\"Geneea News\",\"url\":\"https:\\\/\\\/geneea.com\\\/news\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/geneea.com\\\/news\\\/wp-content\\\/uploads\\\/2022\\\/02\\\/cropped-geneea-logo-50pc.png\",\"contentUrl\":\"https:\\\/\\\/geneea.com\\\/news\\\/wp-content\\\/uploads\\\/2022\\\/02\\\/cropped-geneea-logo-50pc.png\",\"width\":242,\"height\":64,\"caption\":\"Geneea News\"},\"image\":{\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/geneea.com\\\/news\\\/#\\\/schema\\\/person\\\/69c8751a4c026723f4bac2e892f52cd8\",\"name\":\"Marcela Soukupova\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/44f35824640c6a5b31bfef2f478d704874dc3d81bfad511c158ab12274072e16?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/44f35824640c6a5b31bfef2f478d704874dc3d81bfad511c158ab12274072e16?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/44f35824640c6a5b31bfef2f478d704874dc3d81bfad511c158ab12274072e16?s=96&d=mm&r=g\",\"caption\":\"Marcela Soukupova\"},\"sameAs\":[\"http:\\\/\\\/Marcela%20Soukupova\"],\"url\":\"https:\\\/\\\/geneea.com\\\/news\\\/author\\\/marcela-soukupova\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Geneea's AI Spotlight #2 - Geneea News","description":"LLM newsletter #2: practical problems and solutions, Google PaLM 2 and Falcon models, the LIMA model and debugging, plus several non-technical LLM topics.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/geneea.com\/news\/geneeas-ai-spotlight-2","og_locale":"en_US","og_type":"article","og_title":"Geneea's AI Spotlight #2 - Geneea News","og_description":"LLM newsletter #2: practical problems and solutions, Google PaLM 2 and Falcon models, the LIMA model and debugging, plus several non-technical LLM topics.","og_url":"https:\/\/geneea.com\/news\/geneeas-ai-spotlight-2","og_site_name":"Geneea News","article_published_time":"2023-06-09T07:48:36+00:00","article_modified_time":"2026-01-28T08:16:22+00:00","og_image":[{"width":1024,"height":576,"url":"https:\/\/geneea.com\/news\/wp-content\/uploads\/2023\/08\/newsletter2-robot-16x9done-done-done-1024x576.png","type":"image\/png"}],"author":"Marcela Soukupova","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Marcela Soukupova","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/geneea.com\/news\/geneeas-ai-spotlight-2#article","isPartOf":{"@id":"https:\/\/geneea.com\/news\/geneeas-ai-spotlight-2"},"author":{"name":"Marcela Soukupova","@id":"https:\/\/geneea.com\/news\/#\/schema\/person\/69c8751a4c026723f4bac2e892f52cd8"},"headline":"Geneea&#8217;s AI Spotlight #2","datePublished":"2023-06-09T07:48:36+00:00","dateModified":"2026-01-28T08:16:22+00:00","mainEntityOfPage":{"@id":"https:\/\/geneea.com\/news\/geneeas-ai-spotlight-2"},"wordCount":1160,"publisher":{"@id":"https:\/\/geneea.com\/news\/#organization"},"image":{"@id":"https:\/\/geneea.com\/news\/geneeas-ai-spotlight-2#primaryimage"},"thumbnailUrl":"https:\/\/geneea.com\/news\/wp-content\/uploads\/2023\/08\/newsletter2-robot-16x9done-done-done.png","keywords":["AI","generativeAI","newsletter"],"articleSection":["Large language models","Newsletter"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/geneea.com\/news\/geneeas-ai-spotlight-2","url":"https:\/\/geneea.com\/news\/geneeas-ai-spotlight-2","name":"Geneea's AI Spotlight #2 - Geneea News","isPartOf":{"@id":"https:\/\/geneea.com\/news\/#website"},"primaryImageOfPage":{"@id":"https:\/\/geneea.com\/news\/geneeas-ai-spotlight-2#primaryimage"},"image":{"@id":"https:\/\/geneea.com\/news\/geneeas-ai-spotlight-2#primaryimage"},"thumbnailUrl":"https:\/\/geneea.com\/news\/wp-content\/uploads\/2023\/08\/newsletter2-robot-16x9done-done-done.png","datePublished":"2023-06-09T07:48:36+00:00","dateModified":"2026-01-28T08:16:22+00:00","description":"LLM newsletter #2: practical problems and solutions, Google PaLM 2 and Falcon models, the LIMA model and debugging, plus several non-technical LLM topics.","breadcrumb":{"@id":"https:\/\/geneea.com\/news\/geneeas-ai-spotlight-2#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/geneea.com\/news\/geneeas-ai-spotlight-2"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/geneea.com\/news\/geneeas-ai-spotlight-2#primaryimage","url":"https:\/\/geneea.com\/news\/wp-content\/uploads\/2023\/08\/newsletter2-robot-16x9done-done-done.png","contentUrl":"https:\/\/geneea.com\/news\/wp-content\/uploads\/2023\/08\/newsletter2-robot-16x9done-done-done.png","width":1920,"height":1080},{"@type":"BreadcrumbList","@id":"https:\/\/geneea.com\/news\/geneeas-ai-spotlight-2#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/geneea.com\/news"},{"@type":"ListItem","position":2,"name":"Geneea&#8217;s AI Spotlight #2"}]},{"@type":"WebSite","@id":"https:\/\/geneea.com\/news\/#website","url":"https:\/\/geneea.com\/news\/","name":"Geneea News","description":"Learn more about what&#039;s happening at Geneea: new NLP features, newest case studies, tutoring projects, conferences we attended, etc.","publisher":{"@id":"https:\/\/geneea.com\/news\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/geneea.com\/news\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/geneea.com\/news\/#organization","name":"Geneea News","url":"https:\/\/geneea.com\/news\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/geneea.com\/news\/#\/schema\/logo\/image\/","url":"https:\/\/geneea.com\/news\/wp-content\/uploads\/2022\/02\/cropped-geneea-logo-50pc.png","contentUrl":"https:\/\/geneea.com\/news\/wp-content\/uploads\/2022\/02\/cropped-geneea-logo-50pc.png","width":242,"height":64,"caption":"Geneea News"},"image":{"@id":"https:\/\/geneea.com\/news\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/geneea.com\/news\/#\/schema\/person\/69c8751a4c026723f4bac2e892f52cd8","name":"Marcela Soukupova","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/44f35824640c6a5b31bfef2f478d704874dc3d81bfad511c158ab12274072e16?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/44f35824640c6a5b31bfef2f478d704874dc3d81bfad511c158ab12274072e16?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/44f35824640c6a5b31bfef2f478d704874dc3d81bfad511c158ab12274072e16?s=96&d=mm&r=g","caption":"Marcela Soukupova"},"sameAs":["http:\/\/Marcela%20Soukupova"],"url":"https:\/\/geneea.com\/news\/author\/marcela-soukupova"}]}},"_links":{"self":[{"href":"https:\/\/geneea.com\/news\/wp-json\/wp\/v2\/posts\/1525","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/geneea.com\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/geneea.com\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/geneea.com\/news\/wp-json\/wp\/v2\/users\/15"}],"replies":[{"embeddable":true,"href":"https:\/\/geneea.com\/news\/wp-json\/wp\/v2\/comments?post=1525"}],"version-history":[{"count":3,"href":"https:\/\/geneea.com\/news\/wp-json\/wp\/v2\/posts\/1525\/revisions"}],"predecessor-version":[{"id":1566,"href":"https:\/\/geneea.com\/news\/wp-json\/wp\/v2\/posts\/1525\/revisions\/1566"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/geneea.com\/news\/wp-json\/wp\/v2\/media\/1602"}],"wp:attachment":[{"href":"https:\/\/geneea.com\/news\/wp-json\/wp\/v2\/media?parent=1525"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/geneea.com\/news\/wp-json\/wp\/v2\/categories?post=1525"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/geneea.com\/news\/wp-json\/wp\/v2\/tags?post=1525"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}