Possible to create a custom group of users in QDeveloper usage metrics?

Yes, you can isolate and view metrics for specific groups of users in Amazon Q Developer through a couple of approaches:

1. User Activity Reports: You can enable user activity reports which generate daily CSV files containing detailed metrics for individual users. These reports are created at midnight UTC and stored in an Amazon S3 bucket. Each row in the CSV represents a user who interacted with Amazon Q that day, with columns showing various metrics. If you have more than 1,000 users, the data will be split into multiple files. With these CSV files, you could filter or analyze the data for your specific department users.

2. Customizations: You can create customizations in Amazon Q Developer and add specific users or groups to these customizations. To do this, sign in to the AWS Management Console, navigate to the Amazon Q Developer console, select "Customizations," choose your customization, and then use the "Users and groups" tab to add the relevant users or groups from your department. This allows you to manage access to specific customizations for your department users.

The Amazon Q Developer dashboard also provides aggregate metrics, but it doesn't appear to offer filtering by custom user groups directly in the interface. However, with the user activity reports, you would have the raw data to create custom views for your department users.
Sources
Viewing the activity of specific users in Amazon Q Developer - Amazon Q Developer
Viewing Amazon Q Developer user activity on the dashboard - Amazon Q Developer
Monitoring and tracking the use of Amazon Q Developer - Amazon Q Developer
Adding users and groups to your Amazon Q customizations - Amazon Q Developer

Hello,

Currently, similar to CloudWatch Metrics [1] generated by the Amazon Q Developer service, the Amazon Q Developer dashboard [2] also provides aggregate metrics for the all users subscribed to Pro Tier. Further it also does not offer directly filtering the metrics and data by custom user groups directly in the interface.

Thus, to achieve this use-case, you could consider the approach to collect raw data from Amazon Q Developer service regarding User activities for all Pro Tier subscribed Users.

You can do so by enabling "Q Developer user activity reports". This feature allows you to collect user activity telemetry of individual Amazon Q Developer subscribers in your organization and present that information in a report. The report gives you insights into how specific users are using Amazon Q. Please refer AWS Document [3] for more details. For more details on collected telemetry, please refer AWS Document [4]

These user-activity reports are collected within an S3 bucket and making its use you can isolate the data for the custom user group and compare it with the overall/aggregated data.

References -
[1] Monitoring Amazon Q Developer with Amazon CloudWatch - https://docs.aws.amazon.com/amazonq/latest/qdeveloper-ug/monitoring-cloudwatch.html
[2] Viewing Amazon Q Developer user activity on the dashboard - https://docs.aws.amazon.com/amazonq/latest/qdeveloper-ug/dashboard.html
[3] Viewing the activity of specific users in Amazon Q Developer - https://docs.aws.amazon.com/amazonq/latest/qdeveloper-ug/q-admin-user-telemetry.html
[4] User activity report metrics - https://docs.aws.amazon.com/amazonq/latest/qdeveloper-ug/user-activity-metrics.html