We hope you’re as fired up for the weekend as we are. Let’s get into it!

It’s been a big week in the realm of AI. From Google unveiling more LLM’s to Groq showing off their prowess in the Chip space and many announcements in between. Incredibly interesting things happening out there and you can catch up on it in the main articles and the Rapid Fire News Sections below.

However, here at TDAI, we were most impressed with the story of researchers at the University of Louisville developing an AI tool that can detect Autism in children as young as 2 years old, with an accuracy rate of 98.5%. To put that into context, many children aren’t diagnosed until age 8. THIS is the stuff we want to see come out of AI. If you want more on that story, click here.

In this edition:

Own a tool that you would like to see on our site or newsletter please Submit a tool or reach us by replying to this email or at [email protected]

Automate asynchronous standups, retros, surveys, and workflows in Slack & MS Teams

Geekbot is a tool which helps teams automate daily standups, retrospectives, surveys, and other recurring tasks. It integrates with Slack and Microsoft Teams, allowing teams to run asynchronous standup meetings and keep everyone in sync. Geekbot is trusted by over 170,000 users and is designed to save time by turning routine updates into automated workflows.

If you want to share your company or product with fellow AI enthusiasts before we’re fully booked, submit your tool here and sign up!

Greg Brockman is an American entrepreneur, investor and software developer. After attending MIT and Harvard, he began his career at Stripe in 2010 and became their CTO in 2013. In 2015 he left Stripe to join Elon Musk, Sam Altman, and Ilya Sutskever to co-found OpenAI where he is now President and Chairman.

In a significant move that underscores its commitment to advancing artificial intelligence (AI) and its accessibility, Google has recently introduced Gemma, a groundbreaking family of open large language models (LLMs). This initiative marks a pivotal moment in the AI landscape, offering both commercial and research sectors new tools to innovate and explore the vast potential of AI technologies.

Derived from the same cutting-edge research and technology that brought us the Gemini models, Gemma represents a leap forward in lightweight, state-of-the-art open models. Named after the Latin word for "precious stone," Gemma embodies Google's vision of offering valuable and accessible AI tools to the wider community. The launch includes two initial models: Gemma 2B and Gemma 7B, each available in pre-trained and instruction-tuned variants.

Google's Gemma models are designed to be versatile and powerful, capable of running directly on developers' laptops or desktops, as well as on Google Cloud platforms. This flexibility opens up new possibilities for AI application development, allowing for real-time inference and fine-tuning on a wide range of hardware setups. The models have been optimized for performance across NVIDIA GPUs and Google Cloud TPUs, ensuring that they can meet the demands of various use cases and industries.

Moreover, Gemma models are built with Google's AI Principles at the forefront, incorporating automated techniques to filter out sensitive data from training sets and using reinforcement learning from human feedback to align with responsible behaviors. This responsible design is further supported by comprehensive evaluations, including manual red-teaming and automated adversarial testing, to understand and mitigate potential risks associated with the models.

While Google emphasizes the "open" nature of Gemma, it's crucial to distinguish that these models are not open source in the traditional sense. Instead, they are "open models," meaning they are freely accessible for developers and researchers to use, customize, and fine-tune according to their needs, albeit under specific terms of use. This approach aims to foster innovation while ensuring responsible use and distribution of AI technologies.

Gemma's introduction is accompanied by a suite of tools designed to support developer innovation, foster collaboration, and guide the responsible use of these models. This includes the Responsible Generative AI Toolkit, which offers guidance and essential tools for creating safer AI applications, and a debugging tool to help address potential issues in AI behavior.

Developers and researchers can start exploring Gemma models today, with free access available in Kaggle, a free tier for Colab notebooks, and $300 in credits for first-time Google Cloud users. Google also offers up to $500,000 in Cloud credits for researchers to accelerate their projects.

The launch of Gemma by Google represents a significant step forward in the democratization of AI technology. By providing open access to state-of-the-art models, Google is not only fueling innovation but also emphasizing the importance of responsible AI development. The Gemma models, with their blend of accessibility, performance, and ethical design, offer a promising foundation for the next generation of AI applications. As these models are put to use and evolve, it will be fascinating to see the new ways in which developers and researchers leverage AI to solve complex problems, enhance productivity, and create new experiences. The journey of AI is far from over, and initiatives like Gemma ensure that it is a journey marked by collaboration, innovation, and a shared commitment to the greater good.

As we look to the future, the potential for AI to transform industries and societies continues to grow. The key to unlocking this potential lies not just in the technology itself, but in how it is used and governed. With Gemma, Google sets a precedent for the responsible development and deployment of AI, a model that other organizations would do well to follow.

In the rapidly evolving landscape of artificial intelligence (AI), a new contender has emerged, challenging the traditional dominance of graphics processing units (GPUs) in the realm of AI computations. Groq, an innovative AI firm, has introduced a groundbreaking chip known as the Language Processing Unit (LPU), setting new benchmarks in AI inference performance and efficiency.

The LPU, developed by Groq, represents a significant departure from conventional AI processing technologies. Unlike the widely used GPUs, which are optimized for parallel graphics processing and come with thousands of CUDA cores, Groq's LPU is designed specifically for AI computations, offering deterministic performance that ensures consistent latency and throughput. This is achieved through a novel architecture that eschews the SIMD (Single Instruction, Multiple Data) model used by GPUs in favor of a more streamlined approach. By eliminating the need for complex scheduling hardware, the LPU allows every clock cycle to be utilized effectively, translating into faster and more efficient AI inference.

Groq's Tensor Streaming Processor (TSP), the core of the LPU, enables sequences of text to be generated much faster than traditional GPU-based systems. This efficiency is partly due to the LPU's ability to bypass the overhead associated with managing multiple threads and the underutilization of cores. Moreover, TSPs can be linked together and scaled without the bottlenecks typically encountered in GPU clusters, allowing for linear scaling of performance with the addition of more LPUs.

The Groq LPU Inference Engine has quickly gained attention for its impressive performance, with public benchmark tests showcasing its ability to outperform top models by other Big Tech companies. Generating roughly 500 tokens per second, the LPU significantly surpasses the capabilities of existing AI models like ChatGPT-3.5, which operates on GPUs and can generate around 40 tokens per second. This remarkable performance has not only captured the public's imagination but has also sparked discussions on social media platforms about the potential for LPUs to transform AI system operations.

The introduction of Groq's LPU comes at a crucial time when the tech industry is grappling with the scarcity and high costs of powerful GPUs. Groq's solution, utilizing 14nm silicon, offers a more affordable and readily available alternative, with plans to further advance the technology with a 4nm chip made in the United States. This development could alleviate the current AI hardware crunch, enabling faster AI inference and opening new possibilities for large technology firms and governments alike.

Groq's breakthrough with the LPU marks a pivotal moment in the evolution of AI technology. By offering a specialized, efficient, and scalable solution for AI inference, Groq is not just challenging the status quo but also democratizing access to high-performance AI computations. This could lead to more innovative solutions across various sectors, from healthcare to finance, and accelerate the pace of AI advancements.

As we stand on the brink of this new era, it's clear that the implications of Groq's LPU extend far beyond mere technical achievements. They signal a shift towards more accessible, efficient, and powerful AI systems, capable of driving the next wave of innovation and discovery. The future of AI looks brighter and more inclusive, thanks to the visionary efforts of companies like Groq, paving the way for a world where the transformative power of AI is within reach of all who seek to harness it.

If you’re in the Medical space, we encourage you to check out the below list of courses from Vidya: Best Artificial Intelligence courses for Healthcare You should learn 2024