Is the NEW JetBrains AI Assistant BETTER than Copilot? | July 2024 Update

Marco Lenzo
10 Jul 202404:29

TLDRIn this video, the reviewer tests JetBrains' updated AI Assistant, comparing it with GitHub Copilot and Codeium. The new AI Assistant shows improved code completion for Java and Kotlin with reduced latency, but it's still slower and less responsive than Copilot. While JetBrains' assistant offers single and multi-line code suggestions, its quality and prompting system need improvement. The reviewer canceled their subscription, feeling that JetBrains is still behind competitors like Copilot, which is praised for its integration with GitHub and OpenAI's GPT-4o model. Codeium is preferred for personal use due to its speed, quality, and free individual access.

Takeaways

  • 🚀 JetBrains announced an improved AI Assistant in July 2024, aiming to enhance code completion.
  • 💡 To test the new AI Assistant, you need the 2024.2 early access program version 7 of IntelliJ.
  • ⏱️ JetBrains claims reduced latency and higher quality code suggestions powered by their own models.
  • 🔍 The assistant's latency has improved significantly since February, making it more usable.
  • 📉 Despite improvements, the assistant is still less responsive compared to Copilot and Codeium.
  • 🔑 IntelliJ's code completion works in two ways: single-line and multi-line, with single-line suggestions prioritized to reduce perceived latency.
  • 📝 The AI Assistant often provides smaller code snippets compared to Copilot or Codeium, which may not necessarily lead to more relevant suggestions.
  • 🤔 The assistant requires more context to provide suggestions, unlike Copilot and Codeium, which better capture the project's context.
  • 🛠️ The prompting system in the assistant feels clunky and slow, and it still includes imports within the class body, which is an issue.
  • 🔄 The author has canceled their JetBrains AI Assistant subscription, as they believe it is not yet on par with the competition.
  • 💬 The author prefers ChatGPT Plus for its capabilities and speed, and uses Codeium as their personal AI assistant due to its free individual use and similar suggestion quality to Copilot.

Q & A

  • What was the main purpose of JetBrains' announcement on the first of July 2024?

    -The main purpose of the announcement was to introduce the improved code completion feature in their AI Assistant, which is part of the 2024.2 early access program version 7 of IntelliJ.

  • Which version of IntelliJ is required to try out the new AI Assistant from JetBrains?

    -To try out the improved AI Assistant, you need the 2024.2 early access program version 7 of IntelliJ.

  • What are the two different ways IntelliJ performs code completion according to the script?

    -IntelliJ performs code completion in two different ways: single-line and multi-line completion.

  • How does the single-line suggestion feature work in IntelliJ's AI Assistant?

    -Single-line suggestions are shown first because they are powered by a model deployed on the local device, which reduces the perceived latency without increasing network traffic.

  • What is the reviewer's opinion on the latency of the new JetBrains AI Assistant compared to Copilot and Codeium?

    -The reviewer noticed a definite improvement in latency, but still finds the JetBrains AI Assistant less responsive than Copilot and Codeium.

  • What is the reviewer's observation regarding the quality of the suggested code by JetBrains AI Assistant?

    -The reviewer finds that JetBrains AI suggestions are often very small snippets of code compared to Copilot or Codeium, and they don't necessarily lead to more relevant suggestions.

  • How does the JetBrains AI Assistant handle the context of the file being edited?

    -The assistant often requires more context to be added to the file, such as a comment specifying the intended implementation, before providing suggestions.

  • What issue with the JetBrains AI Assistant's code generation does the reviewer find irritating?

    -The reviewer finds it irritating when the assistant includes imports within the class body, which was an issue they were hoping would be addressed in the new version.

  • Why did the reviewer cancel their subscription for the JetBrains AI Assistant?

    -The reviewer canceled their subscription because they believe the JetBrains AI Assistant is not on par with the competition, despite some noticeable improvements.

  • What is the reviewer's current preference for AI code suggestion tools and why?

    -The reviewer prefers using ChatGPT Plus for its capabilities and speed, and uses Codeium as the AI assistant integrated into their personal IDE because it's free for individual use and has similar suggestion quality to Copilot.

  • What does the reviewer suggest for enterprise context and personal IDE setup?

    -For enterprise context, the reviewer suggests using Copilot due to its deep integration with GitHub. For personal IDE setup, they use Codeium because it's free, fast, and provides high-quality suggestions.

Outlines

00:00

🚀 JetBrains AI Assistant Update Review

The script discusses the author's experience with the updated AI Assistant by JetBrains, released on July 1st, 2024. The author subscribed to the new version to evaluate its performance against its predecessor and competitors like GitHub Copilot. The AI Assistant requires the 2024.2 early access program version 7 of IntelliJ and promises improved single and multi-line code completion for Java and Kotlin, powered by JetBrains' own models for better quality and reduced latency. The author notes a significant improvement in latency and responsiveness but still finds it less responsive than Copilot and Codeium. The script also critiques the AI's code suggestion quality, its requirement for additional context, and issues with its prompting system, such as including imports within the class body. The author concludes by sharing their decision to cancel the JetBrains AI assistant subscription, favoring more mature products like GitHub Copilot and their personal preference for ChatGPT Plus and Codeium for different use cases.

Mindmap

Keywords

💡JetBrains AI Assistant

JetBrains AI Assistant is a tool integrated into JetBrains' IntelliJ IDE that offers code completion and suggestions. The video reviews the recent improvements made to this assistant, including better single and multi-line code completion for Java and Kotlin.

💡Copilot

Copilot, developed by GitHub and OpenAI, is an AI-powered code completion tool. The video compares JetBrains AI Assistant with Copilot, highlighting that Copilot is currently more responsive and produces better quality suggestions.

💡IntelliJ

IntelliJ is an integrated development environment (IDE) by JetBrains, used for software development. The video mentions that the improved AI Assistant requires the 2024.2 early access program version 7 of IntelliJ.

💡Codeium

Codeium is another AI-powered code completion tool mentioned in the video. The reviewer compares it with JetBrains AI Assistant and Copilot, noting that Codeium offers free individual use and is fast with high-quality suggestions.

💡Latency

Latency refers to the delay before a transfer of data begins following an instruction. In the video, the reviewer notes that the JetBrains AI Assistant has improved latency compared to previous versions but is still less responsive than Copilot and Codeium.

💡Single-line and Multi-line Code Completion

Single-line code completion suggests one line of code at a time, while multi-line code completion suggests multiple lines. The video explains that IntelliJ’s single-line suggestions are shown first to reduce latency, followed by multi-line suggestions if available.

💡Model

In the context of AI, a model is a mathematical representation of a process. The video mentions that JetBrains uses its own models for the AI Assistant, which are intended to provide higher quality suggestions with reduced latency.

💡Quality of Suggestions

Quality of suggestions refers to how relevant and useful the code suggestions are. The reviewer finds that JetBrains AI Assistant often provides small snippets of code that may require additional context, unlike the more contextual suggestions from Copilot and Codeium.

💡Context

Context refers to the information surrounding a particular code that helps in generating accurate suggestions. The reviewer points out that JetBrains AI Assistant sometimes needs more context, like comments, to provide useful suggestions.

💡Imports

Imports in programming are used to include libraries or modules. The video criticizes JetBrains AI Assistant for incorrectly placing import statements within the class body, an issue that persists despite recent updates.

Highlights

JetBrains announced improved code completion in their AI Assistant on July 1st, 2024.

Subscribers can test the new AI Assistant with the 2024.2 early access program version 7 of IntelliJ.

JetBrains claims the AI Assistant offers improved single and multi-line code completion for Java and Kotlin.

The AI Assistant is powered by JetBrains' own models for higher quality and reduced latency.

There's a noticeable improvement in latency compared to the previous version.

The AI Assistant is still less responsive than Copilot and Codeium.

IntelliJ performs code completion in two ways: single-line and multi-line.

Single-line suggestions are shown first, powered by a local model to reduce latency.

The quality of the suggested code by JetBrains AI is often very small snippets.

JetBrains AI requires more context to provide suggestions compared to Copilot and Codeium.

The prompting system of the AI Assistant is still clunky and slow.

The AI Assistant sometimes includes imports within the class body, which is an irritation.

The reviewer canceled their subscription to the JetBrains AI Assistant due to its shortcomings.

The reviewer prefers the combo of Microsoft and GitHub with OpenAI for its maturity.

ChatGPT Plus subscription is preferred for its capabilities and speed.

The reviewer finds both inline code completion and prompts useful for feature development.

In an enterprise context, the reviewer prefers Copilot due to GitHub integration.

Codeium is used as a free AI assistant for personal IDE due to its quality and speed.

The reviewer invites comments on others' setups and encourages liking and sharing the content.