Skip to content

Known Limitations & Blocked Issues

Blocked by External Constraints

#283: GitHub API Per-Model Premium Billing Data

Status: WONTFIX (API Limitation)

Description: GitHub API does not expose per-model premium billing breakdown. This data is only available through the GitHub web UI's billing dashboard.

Why It's Blocked: - GitHub REST API v3 and GraphQL API do not include granular billing data per model - Enterprise billing aggregation only available via web UI

Workaround: - Navigate to: GitHub Settings → Billing and plans → Usage metrics - Export billing data manually from web dashboard - Use Azure Cost Management for Azure OpenAI consumption instead

Related: Model optimization discussions require this data (see docs/MODEL_OPTIMIZATION.md)


#282: Copilot Usage Metrics Policy Configuration

Status: RESOLVED (2026-05-08)

Description: Enterprise admin has enabled the "Copilot usage metrics" policy. The new /copilot/metrics/reports/ API endpoints are live and returning data.

Note: The old GET /orgs/{org}/copilot/metrics endpoint was sunset 2026-04-02 and replaced by /orgs/{org}/copilot/metrics/reports/organization-28-day/latest. See instructions/enterprise-configuration.instructions.md for updated API reference.


Design Limitations

Skill Refactoring (>5KB Files) — Phase 2 #330

Status: COMPLETE (closed Sprint 15–16)

Resolved: All 12 skills that exceeded 5KB have been modularized using the references/ pattern. Each SKILL.md is now a ≤5KB overview + nav table pointing to focused references/*.md files.

Skills modularized: - Sprint 15 (batch 1): cqrs-event-sourcing, e2e-testing, penetration-testing, microservices-migration, service-bus-migration - Sprint 16 (batch 2): identity-migration, basecoat, tech-debt, dev-containers, api-security, ha-resilience, azure-devops-rest

Remaining skills >5KB for Sprint 17 (batch 3): electron-apps 6.4KB, database-migration 6.1KB, github-security-posture 6.1KB, contract-testing 5.6KB, azure-waf-review 5.3KB, copilot-usage-analytics 5.1KB


Enterprise Prerequisites

Copilot Usage Metrics

Requires: - ✅ GitHub Enterprise Cloud subscription - ⏳ Enterprise admin enablement (external action) - ⏳ 24-48h activation period - ⏳ Permissions: admin:enterprise scope

Post-Enablement: - Organization usage dashboard available - Per-seat active user tracking - Model adoption metrics - Cost per seat reporting


Workarounds & Alternatives

Blocked Feature Workaround Alternative
GitHub API per-model billing Manual export from web UI Azure Cost Analysis for Azure OpenAI models
Copilot metrics collection Enable enterprise policy (admin action) GitHub API audit logs (GET /repos/{owner}/{repo}/audit-log)
Large skill navigation Modular references/ pattern Link to specific reference file in SKILL.md nav

Issue Resolution Path

For Blocked Issues

  1. Assess blocker type: External (API), Enterprise prerequisite, or Design limitation
  2. Document prerequisite: Link to setup guides or admin actions
  3. Provide workaround: Offer alternative if available
  4. Label issue: blocked, prerequisite, or wontfix
  5. Re-evaluate quarterly: Check if API limitations lifted or enterprise policies updated

For Design Limitations

  1. Prototype solution: Create proof-of-concept (e.g., modular skill refactoring)
  2. Test at scale: Apply to 2-3 large skills before full rollout
  3. Document pattern: Add to docs/ for future contributors
  4. Track effort: Estimate hours needed for full implementation
  5. Prioritize: Include in next sprint if high-value

Last Updated: 2026-05-08
Reviewed By: Copilot
Next Review: 2026-06-08