AI activity and impact

Code generated by chat-based agents

This chart shows data related to the additions and deletions of lines of code generated by AI agents in chat interactions and the number of lines of code that the users accepted. The chart shows the following sub-metrics:

• Lines of code rejected: The suggested lines of code that were discarded or rolled back.

• Lines of code accepted: All added or removed lines of code that the users did not discard or roll back.

The data also includes the following sub-metrics:

• Total lines of code generated: All generated lines of code resulting from agent runs. Does not include code generated in read-only modes, such as Ask mode in Junie or Chat mode in AI Assistant. For more information about available modes and what they represent, see Junie and AI Assistant documentation.

• Acceptance rate: The percentage of accepted lines out of the generated lines of code.

This is what the code generation and acceptance flow looks like with different chat-based coding agents.

After a task run, Junie makes changes to one or more files and lists the changes along with the number of added and deleted lines of code per file. The sum of added and deleted lines represents the number of generated lines of code. This sum also represents the number of accepted lines of code before any rollbacks.

If the user decides to roll back some or all changes, the number of added and deleted lines that were rolled back is then subtracted from the total number of accepted lines of code. The following user actions in the IDE count as rollbacks:

1. Clicking the Rollback All button at the beginning of a Junie task.

2. Clicking the rollback button for changes made to a specific file.

3. Clicking the Rollback button at the end of a task.

When using Claude Agent, a completed agent run results in a summary of changes to the files, along with the number of added and deleted lines of code per file. The sum of added and deleted lines counts as the number of generated lines of code. The user can then decide to accept or discard the changes made by the agent completely or partially. All accepted lines of code are added to the total number of accepted lines. Rejected lines of code are those that weren't accepted by the user through one of the following actions:

1. Clicking the Discard all button. This discards all changes generated by the agent.

2. Clicking Discard for a single file. This action discards only the changes made to the specific file.

Code generated by in-editor features

This chart includes data related to the lines of code generated by Code completion and Next edit suggestions and the number of lines that the users accepted. The chart shows the following sub-metrics:

• Lines of code rejected: The suggested lines of code that weren't accepted by the user.

• Lines of code accepted: Depending on the feature, accepted lines of code are counted as follows:

  • Code completion: All lines of code that were inserted into the editor. When the user partially accepts a suggestion, lines are counted as follows:

    • When the user accepts a part of a single line, this counts as one accepted line.

    • In multi-line suggestions, the number of accepted lines is the number of lines that the user accepted to insert.

  • Next edit suggestions: The number of lines that the user accepted to insert into the editor or delete from the editor. In a multistep suggestion flow, the number of accepted lines is added to the total count after each step.

  For more information about user actions in the IDE to accept or reject suggestions, see Code completion and Next edit suggestions.

The data also includes the following sub-metrics:

• Total lines of code generated: Depending on the specific code suggestion feature, generated lines of code are counted as follows:

  • Code completion: The total number of lines that were shown to the users as suggestions in the editor.

  • Next edit suggestions: The total number of shown lines in the editor that the user can choose to insert and delete.

• Acceptance rate: The percentage of accepted lines of code out of all generated lines.

Lines of code modified by chat-based agents

This chart shows the number of lines that were added, modified, or deleted as a result of chat interactions with a chat-based agent. You can optionally select to show data only for a subset of agents.

Lines of code modified by in-editor features

This chart shows the number of lines that were added, modified, or deleted by in-editor code suggestion features. You can optionally choose to show data for a subset of features.

Messages sent to AI chats

This chart shows the number of messages that the users sent to AI chats for the selected period. It provides insights into the number of interactions with AI tools over a period of time, which can help you understand agent adoption and usage volume trends in your organization.

Each message that the user sends increases the number of sent messages by one.

You can optionally select to show data only for the selected agents.

Suggestions shown by in-editor features

This chart shows the number of suggestions that the in-editor code suggestion features showed to the users. Each time the editor shows a suggestion increases the number of suggestions shown by one, regardless of how many lines the suggestion includes. You can optionally select to show data only for the selected AI features.