Overview: Innovation Strategy

Full title: "The Impact of Generative AI on Critical Thinking: Self-Reported Reductions in Cognitive Effort and Confidence Effects From a Survey of Knowledge Workers", first viewed and discussed on Bluesky."higher confidence in GenAI is associated with less critical thinking, while higher self-confidence is associated with more crit…

OpenSocial's AI integration provides "a unique AI model trained on your specific platform data... Gaia Chatbot transforms how you access information, making every interaction a seamless exchange of knowledge discovery".Works with all AI providersautomatic tagging and classification"adapts in real time to user ... individualized…

"most people think AI is human more than half the time. Apparently, AI does, too" - and by providing good examples (fiction, poetry), she's convinced me that I can't tell the difference, either. Only SurferSeo comes out well as an automatic AI detector in all examples.The only content that most (but not all) detectors performed…

Gary Marcus pouring cold water on Deep Research, "which... can write science-sounding articles on demand, on any topic of your choice".In many ways there's not much new here, except perhaps for how model collapse will affect science, not just LLMs.As known:LLMs flooding the zone with shit has been a concern since the beginning, and …

"Could seeing how opposite sides of the US political spectrum use the same words differently be a first step toward greater cross-political understanding?... What if generative AI could help us understand people with opposing views better just by showing how they use common words and phrases differently?"MIT's Bridging Dictionary…

I've been cleaning out a few rotten systems recently.

Simon Willison's "review of things we figured out about [LLMs] in the past twelve months, plus my attempt at identifying key themes and pivotal moments" has 19 major points:"GPT-4 barrier was comprehensively broken": the year saw 18 organizations produce "models on the Chatbot Arena Leaderboard that rank higher than t…

In a "1964 essay by historian and cultural critic Lewis Mumford, “Authoritarian and Democratic Technics”... Mumford warned about the “magnificent bribe” that accounts for why “our age surrendered so easily to the controllers, the manipulators, the conditioners". The bribe "Under the democratic-authoritarian social contract"? Ev…

"Let our AI analyze your posts, roast your takes, and reveal what your posting history says about you".Honestly not roasty at all - rather hagiographic, judging by mine, but who am I to argue with a 88% authenticity score, even if I have no idea how that is measured? https://blueskyroast.com/roast/mathewlowry.bsky.social.But a pretty coo…

A convincing argument from paragraph one: "You would never ever in a million years build your own CRM system or custom CMS — or in most cases, your own LLM. ... yet, everywhere I look, I see IT departments convincing themselves that building their own RAG-based chat is somehow different. It’s not. It’s actually worse."The author then enu…

Via Ross Dawson on LinkedIn: "A core part of human intelligence is the ability to work flexibly with others to achieve both individual and collective goals". Unfortunately, intelligence is usually considered as a property of individual or collective, never both, and so "not in a way that can be used to understand how groups can make…

My late October 2024 newsletter introduces my ongoing work exploring #AI4Communities, and provides some of the resources going into the next version.

I think I'll call these 'centaur papers' - scientific papers describing how best to combine human and AI.Apparently theory and practice aren't matching up: "While frameworks on augmentation theorize how to best divide work between humans and AI, the empirical literature ... [shows] inconclusive findings. Interaction challe…

According to Mark Zuckerberg, "Consumers no longer control their social-media feeds. Meta’s algorithm... is showing users “a lot of stuff” not posted by people they had connected with... future feeds [will] show you “content that’s generated by an A.I. system.”" Fortunately, "Our legal system is starting to recognize this shift and …

"AI can not only improve short-term productivity of organizations but can also ... increase the organization’s collective intelligence."HBR starts well by pointing out the false dichotomy between thinking "about AI in terms of automation vs. augmentation... Augmentation doesn’t avoid automation, it simply hides it, usually in some l…

"I rarely work for the same client for more than a year or two - generally enough to help them figure out their strategy, pilot and demonstrate it, and set up the team to mainstream it. But I make an exception for the Joint Research Centre"A few slides, repurposed for LinkedIn, setting out "some of the key innovations underpinning t…

As AI drives a flood of new content, "algorithms to help people sort through information must evolve rapidly" - ie, we need AI to solve AI-created problems.Today's algorithms belong to for-profit platforms, mainly social media, and lack transparency: while you can influence it through who you follow, "your ability to truly cust…

"over-reliance on AI... may lead to human deskilling and diminished cognitive engagement... to accept information given by AI without performing critical examinations... misleading users with hallucinated contents... [hence] extraheric AI... conceptual framework that fosters users' higher-order thinking ... creativity, critical thinking,…

The Brave browser project shows that it was ahead of the curve back in late 2023, pointing out:to train an LLM you need training data which is "diverse... span[ning] a wide variety of genres, topics, viewpoints, languages, and more... [to] reduce the errors, biases, and misrepresentations that might be more pronounced in smaller data sets... …

Classic example of a negative view on LinkedIn: "Unlike many others, I don’t think any reinforcement learning or reward algorithm is at play... appears to be a generic Chain-of-Thought (CoT) process that breaks tasks into several steps... Subsequent steps ... generated based on context... subsequent interactions concatenated into the context.…

“If you read 1,000 papers and build a powerful representation, humans can interrogate, mine, ask questions, and even get the system to generate new hypotheses...What you will learnAccelerating scientific discovery with generative knowledge extractionUnderstanding ontological knowledge graphs and their creationTransforming information into knowledg…

“About one in four people who began the experiment believing a conspiracy theory came out the other end without that belief... challenges conventional wisdom that evidence and arguments rarely help to change believers’ minds... [as they're] adopting such beliefs to meet various needs – such as a desire for control."The researchers develo…

"examines the impact of AI on human false memories--recollections of events that did not occur or deviate from actual occurrences... through suggestive questioning in Human-AI interactions, simulating crime witness interviews. Four conditions were tested: control, survey-based, pre-scripted chatbot, and generative chatbot" The 200 people…

A Large-Scale Human Study with 100 NLP Researchers

"AI-powered tool designed to assist users in building software ... [from] natural language prompts ... create applications from scratch.

AI is a wider field than LLMs, so "not all the AI use cases are suitable for Generative AI."

"The most common AI-based functionalities in participation tools are toxicity screening, analysis of inputs and translation. The first two in particular are meant to lighten the workload" of community managers."Toxicity screening ... is used to flag hateful or inappropriate inputs." Text is usually flagged and post-moderated, b…

Starts with a basic outline of model collapse and the challenge it faces new AI development, providing several links: "Research has shown that when generative A.I. is trained on a lot of its own output, it can get a lot worse."It then uses scrollytelling to provide a simple example of how "Just as a copy of a copy can drift away fro…

"A deep dive into why RAG doesn’t always work".It should be easy: "install a popular LLM orchestrator like LangChain or LlamaIndex, turn your data into vectors, index those in a vector database, and quickly set up a pipeline with a default prompt."However, while "quick-and-dirty demos are great for understanding the basics…

"As AI-generated content blurs the line between human and machine online, “model collapse” might help us find new value in well-managed human communities."