azure-event-hubs

Azure Event Hubs Skill

This skill provides expert guidance for Azure Event Hubs. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content with remote documentation fetching capabilities.

How to Use This Skill

IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., L35-L120), use read_file with the specified lines. For categories with file links (e.g., [security.md](security.md)), use read_file on the linked reference file

IMPORTANT for Agent: If metadata.generated_at is more than 3 months old, suggest the user pull the latest version from the repository. If mcp_microsoftdocs tools are not available, suggest the user install it: Installation Guide

This skill requires network access to fetch documentation content:

• Preferred: Use mcp_microsoftdocs:microsoft_docs_fetch with query string from=learn-agent-skill. Returns Markdown.
• Fallback: Use fetch_webpage with query string from=learn-agent-skill&accept=text/markdown. Returns Markdown.

Category Index

Category	Lines	Description
Troubleshooting	L37-L49	Diagnosing and fixing Event Hubs runtime issues: Kafka/AMQP errors, .NET/legacy exceptions, ARM failures, auth problems, connectivity, and Blob Storage checkpoint store errors.
Best Practices	L50-L56	Best practices for integrating Event Hubs via AMQP/Kafka/HTTPS, building stateless replication with Functions, and scaling with partitions and throughput units.
Decision Making	L57-L63	Guidance on choosing Event Hubs tiers, auto-inflate settings, geo-replication modes, and planning migrations from Apache Kafka to Event Hubs.
Architecture & Design Patterns	L64-L69	Patterns and guidance for Event Hubs reliability: availability/consistency design, geo-disaster recovery, and building/operating replication tasks (often with Azure Functions).
Limits & Quotas	L70-L79	Event Hubs limits, quotas, and tier differences; max message sizes, capture intervals, platform behaviors, and governance via application groups.
Security	L80-L108	Securing Event Hubs: auth (Entra ID, SAS, RBAC, managed identities), encryption/CMK, confidential computing, TLS, and network access (NSP, VNet, firewall, Private Link, Azure Policy compliance).
Configuration	L109-L121	Configuring Event Hubs behavior: partitions, retention, cleanup, geo-DR, replication, log compaction, Avro capture, monitoring, app groups, and using the local emulator.
Integrations & Coding Patterns	L122-L139	Patterns and code for integrating Event Hubs with .NET, Kafka (clients, Streams, Connect, Debezium), Flink, Spark, Akka, schema/JSON registry, and adding metadata or managing hubs programmatically
Deployment	L140-L145	Guides for deploying Event Hubs with Kafka mirroring (MirrorMaker 1/2), setting up geo-replication, and running/local-testing Event Hubs apps using the emulator.

Troubleshooting

Topic	URL
Resolve common Azure Event Hubs Kafka migration issues	https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-frequently-asked-questions
Troubleshoot Azure Event Hubs for Apache Kafka	https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-troubleshooting-guide
Troubleshoot AMQP errors in Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-amqp-troubleshoot
Handle legacy Azure Event Hubs messaging exceptions	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-messaging-exceptions
Handle Azure Event Hubs .NET exceptions and recommended actions	https://learn.microsoft.com/en-us/azure/event-hubs/exceptions-dotnet
Resolve Azure Resource Manager exceptions for Event Hubs operations	https://learn.microsoft.com/en-us/azure/event-hubs/resource-manager-exceptions
Troubleshoot authentication and authorization failures in Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/troubleshoot-authentication-authorization
Resolve Blob Storage checkpoint store issues for Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/troubleshoot-checkpoint-store-issues
Diagnose and fix Azure Event Hubs connectivity issues	https://learn.microsoft.com/en-us/azure/event-hubs/troubleshooting-guide

Best Practices

Topic	URL
Exchange Event Hubs events across AMQP, Kafka, and HTTPS	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-exchange-events-different-protocols
Design stateless event replication with Azure Functions	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-federation-replicator-functions
Scale Azure Event Hubs with partitions and throughput units	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-scalability

Decision Making

Topic	URL
Plan migration from Apache Kafka to Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-migration-guide
Decide when and how to use Event Hubs Auto Inflate	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-auto-inflate
Choose and manage Azure Event Hubs geo-replication modes	https://learn.microsoft.com/en-us/azure/event-hubs/geo-replication

Architecture & Design Patterns

Topic	URL
Design for availability and consistency in Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-availability-and-consistency
Apply Event Hubs event replication task patterns	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-federation-patterns

Limits & Quotas

Topic	URL
Compare Event Hubs tier features and quotas	https://learn.microsoft.com/en-us/azure/event-hubs/compare-tiers
Configure Event Hubs Capture intervals and limits	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-capture-overview
Azure Event Hubs platform limits and behavioral details	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-faq
Send and receive large Event Hubs messages	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-quickstart-stream-large-messages
Review Azure Event Hubs quotas and limits	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-quotas
Govern Event Hubs resources with application groups	https://learn.microsoft.com/en-us/azure/event-hubs/resource-governance-overview

Security

Topic	URL
Associate network security perimeters with Event Hubs namespaces	https://learn.microsoft.com/en-us/azure/event-hubs/associate-network-security-perimeter
Authenticate applications with Entra ID for Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/authenticate-application
Use managed identities to authenticate to Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/authenticate-managed-identity
Authenticate to Event Hubs from VMs with managed identity	https://learn.microsoft.com/en-us/azure/event-hubs/authenticate-managed-identity-virtual-machine
Implement SAS authentication for Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/authenticate-shared-access-signature
Authorize Event Hubs access using Entra ID and RBAC	https://learn.microsoft.com/en-us/azure/event-hubs/authorize-access-azure-active-directory
Choose and configure Event Hubs authorization options	https://learn.microsoft.com/en-us/azure/event-hubs/authorize-access-event-hubs
Configure SAS authorization for Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/authorize-access-shared-access-signature
Enable confidential computing for Azure Event Hubs Dedicated	https://learn.microsoft.com/en-us/azure/event-hubs/confidential-computing
Configure customer-managed keys for Event Hubs encryption	https://learn.microsoft.com/en-us/azure/event-hubs/configure-customer-managed-key
Enable and configure managed identities for Event Hubs namespaces	https://learn.microsoft.com/en-us/azure/event-hubs/enable-managed-identity
Configure managed identity for Event Hubs Capture	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-capture-managed-identity
Retrieve and understand Event Hubs connection strings	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-get-connection-string
Configure IP firewall rules for Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-ip-filtering
Secure Event Hubs with virtual network service endpoints	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-service-endpoints
Configure network security for Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/network-security
Secure Event Hubs with Network Security Perimeter	https://learn.microsoft.com/en-us/azure/event-hubs/network-security-perimeter
Migrate Event Hubs apps to passwordless authentication with Entra ID	https://learn.microsoft.com/en-us/azure/event-hubs/passwordless-migration-event-hubs
Use built-in Azure Policy definitions for Event Hubs governance	https://learn.microsoft.com/en-us/azure/event-hubs/policy-reference
Restrict Event Hubs access using Private Link endpoints	https://learn.microsoft.com/en-us/azure/event-hubs/private-link-service
Apply regulatory compliance policies to Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/security-controls-policy
Audit Event Hubs TLS compliance using Azure Policy	https://learn.microsoft.com/en-us/azure/event-hubs/transport-layer-security-audit-minimum-version
Configure Event Hubs client applications to use specific TLS versions	https://learn.microsoft.com/en-us/azure/event-hubs/transport-layer-security-configure-client-version
Set minimum TLS version for Azure Event Hubs namespaces	https://learn.microsoft.com/en-us/azure/event-hubs/transport-layer-security-configure-minimum-version
Enforce minimum TLS version for Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/transport-layer-security-enforce-minimum-version

Configuration

Topic	URL
Configure partitioning, retention, and cleanup for Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/configure-event-hub-properties
Configure geo-disaster recovery pairing for Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/configure-geo-disaster-recovery
Dynamically increase partitions in an Event Hub	https://learn.microsoft.com/en-us/azure/event-hubs/dynamically-add-partitions
Configure code-free Event Hubs replication tasks	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-federation-configuration
Understand and use Event Hubs captured Avro schema	https://learn.microsoft.com/en-us/azure/event-hubs/explore-captured-avro-files
Reference monitoring metrics and logs for Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/monitor-event-hubs-reference
Configure Event Hubs application groups for resource governance	https://learn.microsoft.com/en-us/azure/event-hubs/resource-governance-with-app-groups
Configure and run the Azure Event Hubs emulator locally	https://learn.microsoft.com/en-us/azure/event-hubs/test-locally-with-event-hub-emulator
Configure and use log compaction in Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/use-log-compaction

Integrations & Coding Patterns

Topic	URL
Add custom metadata to Event Hubs events	https://learn.microsoft.com/en-us/azure/event-hubs/add-custom-data-event
Configure Apache Kafka clients for Azure Event Hubs compatibility	https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-configurations
Use Kafka Streams with Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-streams
Use Kafka transactions with Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-transactions
Connect .NET applications to Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/connect-event-hub
Connect Akka Streams to Azure Event Hubs via Kafka	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-akka-streams-tutorial
Use Debezium CDC with Kafka Connect on Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-connect-debezium
Integrate Kafka Connect with Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-connect-tutorial
Connect Apache Flink to Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-flink-tutorial
Connect Apache Spark streaming apps to Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-spark-tutorial
Use .NET management libraries to provision Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-management-libraries
Implement client-side schema enforcement for Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/schema-registry-client-side-enforcement
Use JSON Schema registry with Kafka clients on Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/schema-registry-json-schema-kafka
Choose and use client SDKs for Azure Event Hubs	https://learn.microsoft.com/en-us/azure/event-hubs/sdks

Deployment

Topic	URL
Mirror Kafka brokers to Event Hubs with MirrorMaker 1	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-mirror-maker-tutorial
Replicate Kafka clusters to Event Hubs with MirrorMaker 2	https://learn.microsoft.com/en-us/azure/event-hubs/event-hubs-kafka-mirrormaker-2-tutorial
Configure and operate Event Hubs geo-replication	https://learn.microsoft.com/en-us/azure/event-hubs/use-geo-replication