Adobe is bringing AI-powered video generation to Firefly later this year. The new features, while still in beta, could change the game for creatives by making complex video editing tasks much faster and easier.
What’s Inside
Staple Add-Ons
⟢ Adobe Firefly Makes Video Creation Easy
⟢ Google’s NotebookLM Now Talks to You
⟢ Mistral’s New AI Can See and Talk
⟢ Superb AI Tools
⟢ AI Tutorials and How-Tos
⟢ Everything You Need to Know
Best AI news of the day!
Daily Additions
➊ Adobe Firefly Makes Video Creation Easy
Adobe Firefly will soon let users make and extend videos using text or images. This AI tool aims to speed up video editing for both pros and beginners. (More below)
➋ Google’s NotebookLM Now Talks to You
NotebookLM can now explain your notes out loud. It uses AI voices to summarize and teach complex topics from your uploaded documents. (More below)
➌ Mistral’s New AI Can See and Talk
Mistral launched Pixtral 12B, an AI that understands images and text. It’s free to use and can describe pictures, count objects, and answer questions about images. (More below)
➍ LLaMA-Omni Challenges Big Tech Assistants
LLaMA-Omni, a new open-source AI, can do tasks like Siri and Alexa. It’s free, works offline, and can be customized, making it a strong rival to big tech assistants. (More below)
➎ Oracle Introduces AI Agents for Businesses
Oracle’s new AI agents automate tasks across apps. They boost productivity and help workers focus on important jobs. (More below)
➏ Gen Z Turns to AI for Holiday Shopping Help
Young shoppers plan to use AI tools for gift ideas and price comparisons this season. Many Gen Z consumers trust AI more than human salespeople. (More below)
Free Gifts
Additional resources just for you!
✦ The top news expanded!
Adobe Firefly Makes Video Creation Easy
Adobe’s Firefly will introduce AI-powered video generation features like Generative Extend, Text-to-Video, and Image to Video by the end of 2024. These features will be available on Premiere Pro beta and a free website, with Generative Extend adding up to 2 seconds to videos and Text/Image to Video creating up to 5-second clips.
WHAT DOES THIS MEAN?
This means Adobe is integrating AI into video editing, making tasks faster and easier. Generative Extend uses the last few frames of a scene to predict and add the next couple of seconds, while Text-to-Video and Image-to-Video generate short clips from prompts. According to Adobe’s CTO, Ely Greenfield, these tools aim to complement existing workflows, similar to how Firefly’s generative fill feature in Photoshop has become widely used.
WHY SHOULD I CARE?
These AI tools can significantly speed up video editing tasks, potentially changing the content creator industry. Early attempts at AI video generation have been unpredictable, but Adobe’s focus on controllability could set it apart. This could be particularly beneficial for professionals looking to accelerate their workflows without sacrificing quality.
WHAT SHOULD I DO?
Start preparing to integrate these AI tools into your video editing workflow. Consider how Generative Extend, Text-to-Video, and Image-to-Video can help you save time and improve your content. As per Adobe’s plans, these features will be available on Premiere Pro beta and a free website, so be ready to explore and utilize them to enhance your video creation process. In the meantime, you can join the waitlist here.
✦ The top news expanded!
Google’s NotebookLM Now Talks to You
Google’s AI note-taking app NotebookLM can now explain complex topics out loud using audio conversations. This feature generates summaries and explanations of uploaded documents, such as course readings or legal briefs, in a conversational tone.
WHAT DOES THIS MEAN?
This means that users who learn better by listening can now use NotebookLM to grasp complicated concepts more easily. The app uses AI-generated virtual hosts to summarize and explain source materials, making it easier to find connections between documents or get inspiration for drafts. According to Google, the feature is still in beta and may have some inaccuracies.
WHY SHOULD I CARE?
This feature can be a game-changer for people who struggle with reading complex texts. NotebookLM can help users find new connections between documents or get inspiration for drafts, making it a valuable tool for students, researchers, and professionals.
WHAT SHOULD I DO?
If you’re interested in trying out NotebookLM’s audio conversations, open an existing notebook, navigate to the Notebook guide, and click on the “generate” button on the right-hand side. You can also download the conversation and listen to it on the go to get a quick understanding of your source materials. The feature is available in English and can take up to five minutes to generate.
In partnership with Salina
Speak Like a Local with Content that’s Global
Ensure your message resonates globally by delivering culturally authentic content in multiple languages.
✦ The top news expanded!
Mistral’s New AI Can See and Talk
Mistral releases Pixtral 12B, a 12-billion-parameter AI model that processes images and text. It’s available for free under an Apache 2.0 license and can be downloaded from GitHub and Hugging Face.
WHAT DOES THIS MEAN?
Pixtral 12B is a multimodal model that can understand and describe images, count objects, and answer questions about them. It’s built on Mistral’s text model, Nemo 12B, and can process images of any size. This means it can perform tasks like image captioning and object counting, similar to other multimodal models like Anthropic’s Claude family and OpenAI’s GPT-4o.
WHY SHOULD I CARE?
This news matters because Pixtral 12B is a significant step in AI development, offering a free and open model that can be fine-tuned and used without restrictions. Mistral’s strategy involves releasing free models and charging for managed versions, making it an important player in the AI community. As a content marketer or creator, this means you can explore new possibilities in image and text processing.
WHAT SHOULD I DO?
If you’re interested in exploring Pixtral 12B, download it from GitHub or Hugging Face and start experimenting with its capabilities. According to Sophia Yang, Head of Developer Relations at MistralAI, it will soon be available for testing on Mistral’s chatbot and API-serving platforms, Le Chat and Le Plateforme. Consider how you can integrate this technology into your content creation workflow to enhance your image and text processing capabilities.
✦ The top news expanded!
LLaMA-Omni Challenges Big Tech Assistants
LLaMA-Omni, a new open-source AI, can do tasks like Siri and Alexa. It’s free, works offline, and can be customized. LLaMA-Omni is built on Llama-3.1-8B-Instruct, ensuring high-quality responses—rivaling big tech assistants.
WHAT DOES THIS MEAN?
This means LLaMA-Omni can perform tasks like answering questions, setting reminders, and controlling smart devices without relying on internet connectivity. Its customizability allows developers to fine-tune the AI for specific use cases.
WHY SHOULD I CARE?
LLaMA-Omni’s open-source nature and offline capabilities make it a game-changer for developers and users who value privacy and flexibility. This could potentially disrupt the dominance of big tech assistants like Siri and Alexa.
WHAT SHOULD I DO?
If you’re a developer, explore LLaMA-Omni’s capabilities and consider integrating it into your projects. If you’re a user, keep an eye out for apps and devices that utilize LLaMA-Omni, as they may offer more customizable and private AI experiences. You can also contribute to the development of LLaMA-Omni on GitHub.
AI how-tos, tutorials, and guides!
Common Denominators
➀ How to Repurpose Your Podcast into Social Content
Learn how to repurpose your episodes into engaging content that’ll have your followers hooked, with these 7 simple steps using AI tools to make it a breeze!
➁ How to Choose the Best Audio Transcription Software
Check out this guide to the top 7 AI-powered tools of 2024, and find the perfect fit for your transcription needs without breaking a sweat!
➂ How to Write Faster Using AI
10 practical tips to help you write faster, from embracing rough drafts to using AI tools, and say goodbye to writer’s block for good!
✦ The top news expanded!
Oracle Introduces AI Agents for Businesses
Oracle introduces AI agents that automate tasks across apps, increasing productivity. Available now, these agents help workers focus on important jobs.
WHAT DOES THIS MEAN?
These AI agents simplify tasks by automating them across different applications. As mentioned in the Press Release, this helps workers focus on more important tasks, making their work more efficient. Some of the agents are Shift scheduling assistant, Benefits analyst, and Customer account researcher agent.
WHY SHOULD I CARE?
This is important because it can save time and increase productivity for businesses. According to Oracle, these AI agents can help organizations achieve new levels of productivity, which can lead to better outcomes.
WHAT SHOULD I DO?
Check if your organization can benefit from Oracle’s AI agents. Look into how these agents can automate tasks and increase productivity in your workplace. Consider integrating these agents into your workflow to help your workers focus on more important tasks.
✦ The top news expanded!
Gen Z Turns to AI for Holiday Shopping Help
Gen Z shoppers plan to use AI tools for gift ideas and price comparisons this holiday season. 70% of Gen Z report using the technology and 52% of them trust the technology to help them make informed decisions.
WHAT DOES THIS MEAN?
This means that young shoppers are embracing AI technology to make their holiday shopping experience more efficient. AI tools provide personalized gift ideas and help with price comparisons, making it easier for Gen Z consumers to find what they’re looking for.
WHY SHOULD I CARE?
This shift to AI-powered shopping experiences can impact how you reach and engage with your target audience. Gen Z consumers are more likely to trust AI recommendations over human salespeople, which can affect your marketing strategy.
WHAT SHOULD I DO?
Consider incorporating AI-powered tools into your marketing strategy to reach Gen Z consumers. Use AI-driven chatbots to provide personalized recommendations and improve customer engagement. Gen Z consumers use AI-powered chatbots for shopping, so it’s essential to adapt to this trend to stay competitive.
Best of Reddit today!
Reddit-Wrapped
꩜ How to Survive a Downvote on Reddit
꩜ AI lipreading is here
꩜ Mistral drops a new magnet link
꩜ Jina AI Releases HTML to Clean Markdown
꩜ Fish Speech 1.4: new open Text-to-Speech model
AI news you might have missed!
Quick Maths
⟢ Apple Announces iPhone 16 and More
Apple revealed the iPhone 16, Apple Intelligence, AirPods 4, and more at its 2024 event, “It’s Glow Time.” The iPhone 16 starts at $799, with the 16 Pro starting at $999. Apple Intelligence is launching as a beta in the U.S. in the fall, with localized English coming to several markets in December.
⟢ Hugging Face Launches New AI Evaluation Tool
Hugging Face introduces LightEval, a new open-source tool for evaluating large language models (LLMs). It helps companies assess AI models in a customizable way, ensuring they meet specific business needs and ethical standards.
⟢ AirPods Pro 2 is Now a Clinical-Grade Hearing Aid
Apple’s AirPods Pro 2 can now be used as clinical-grade hearing aids, although they are not yet FDA-approved. The earbuds have the same capabilities as over-the-counter hearing aids. A new 5-minute hearing test on iOS 18 will allow users to check their hearing health and store the results.
⟢ Building AI Products That Live Up to the Hype
Mike Krieger, Instagram co-founder, now Chief Product Officer at Anthropic, aims to build reliable, useful AI that delivers on its promises.
⟢ AI Bookkeeping Startup Finally Raises $200M
Finally, a Miami-based AI bookkeeping startup, has raised $200M in funding, including $50M in Series B and a $150M credit line. This brings the company’s total funding to $305M since its inception in 2018.
⟢ AI Tackles Heart Disease
Cambridge startup CardiaTec uses AI to analyze heart tissue data from 65 hospitals, aiming to find new treatments for cardiovascular diseases. They’ve raised $6.5 million to support their research.
Superb AI tools to add to your life!
Top-Up Your Toolbox
✰ Salina • Turn videos into newsletters.
✰ VoiceCheap • Translate any video in any language.
✰ Prompt Refiner • Optimize your AI prompts in an instant.
✰ Super • Turn Notion pages into customizable web pages.
✰ MidJourneysref • Prompts for high-quality MidJourney art.
Do you want to stay current with the latest AI news?
At ai + u, we deliver fresh, engaging, and digestible AI updates.
Stay tuned for more exciting developments!
Let’s see what stories we can bring to life next.
See you next addition!