Azure HDInsight on AKS documentation (Preview)

HDInsight on AKS, a new HDInsight version, provides enterprise-ready managed cluster service with emerging open-source analytics.

• Azure HDInsight on AKS documentation
• Overview
  • What is HDInsight on AKS?
  • Preview information
  • What's new?
• Quickstarts
  • Subscription prerequisites
  • Resource prerequisites
  • One click deployment
  • Create cluster pool
    • Create cluster pool - Azure portal
    • Create cluster pool - Azure CLI
    • Create cluster pool - Azure PowerShell
• Concepts
  • Reliability
  • Versioning
  • Enterprise security
    • Security architecture and security pillars
    • Security baseline for Azure HDInsight on AKS
    • Network Security
      • Ingress and Egress controls
      • Required outbound traffic
  • Resource management
  • Metrics and monitoring
  • Customize clusters
  • In-place upgrades
• Releases
  • Release notes
  • Archived release notes
• Get started
  • Introduction to cluster storage
  • Secure network traffic
    • Use firewall with Azure CLI
    • Use firewall with Azure portal
    • Use NSG to restrict traffic
  • Export cluster ARM template
    • Export ARM template using Azure portal
    • Export ARM template using Azure CLI
  • Tutorials
    • Manage HDInsight on AKS clusters - .NET SDK
    • Manage HDInsight on AKS clusters - PowerShell
    • Manage HDInsight on AKS clusters - REST API
• Manage
  • Cluster pools
  • Clusters
  • Manual scale
  • Auto scale
  • Access control
  • Service health
  • Service configuration
  • Script actions
  • Azure Monitor integration
    • Log Analytics
    • Azure managed Prometheus and Grafana
• Trino
  • What is Trino?
  • Create Trino cluster
  • Connect and query
    • Authentication
    • Trino CLI
    • Trino Web SSH
    • Trino JDBC driver
    • Trino with DBeaver
    • Trino UI
  • Connectors
    • Catalogs
    • Configure Delta Lake catalog
    • Configure Iceberg catalog
    • Configure sharded SQL connector
  • Cluster management
    • Trino configuration
    • Hive metastore
    • Custom plugins
    • Query logging
    • Caching
    • JVM Heap settings
    • Miscellaneous files
    • Fault tolerance
    • Troubleshoot
  • How-to guides
    • Use Apache Superset with Trino cluster
      • Deploy Apache Superset
      • Configure Microsoft Entra ID OAuth2 login
      • Role Based Access Control
      • Expose Superset to the internet
    • Read Delta Lake Tables Synapse or external locations
    • Use query scan statistics
    • Use Apache Airflow with Trino cluster
    • Use AWS S3 and Glue with Trino cluster
• Apache Flink®
  • What is Apache Flink® in Azure HDInsight on AKS?
  • Create Apache Flink cluster
  • Tutorials
    • Application Mode clusters
    • Configuration management
    • Job management
    • Hive dialect in Flink
    • Table API and SQL
    • SQL gateway
  • How-to guides
    • General
      • Flink Command Line Interface CLI
      • Use Azure portal to access CLI
      • Azure Cosmos DB Apache Cassandra
      • Azure Databricks
      • Azure Service Bus
      • Azure Data Explorer
      • Azure Event Hubs
      • Azure IoT Hub
      • Azure Pipelines
      • Azure Data Factory Workflow Orchestration Manager
      • Delta connectors
      • Elastic and Kibana
      • Apache Kafka on HDInsight
    • Flink SQL
      • CDC - Azure PostgreSQL and FlinkSQL
      • CDC - SQL Server and FlinkSQL
      • Kafka table on FlinkSQL
      • Hive Catalog and FlinkSQL
      • Iceberg Catalog
      • Delta Catalog
    • Flink streaming
      • ADLS Gen2 - Write with Flink DataStream API
      • Apache NiFi with Flink DataStream API
      • CDC - SQL Server and Flink DataStream API
      • Hive metastore with Flink DataStream API
      • HBase - Write with Flink DataStream API
      • MongoDB as a source and Sink with Flink DataStream API
      • Join stream from Kafka with Table on ADLS Gen2 with Flink DataStream API
      • Microsoft Fabric with Flink DataStream API
    • Use cases
      • Fraud detection with the Flink DataStream API
    • Troubleshoot
      • Flink cluster configuration
• Apache Spark™
  • What is Apache Spark™ in HDInsight on AKS?
  • Create Apache Spark cluster
  • How-to guides
    • Azure Data Factory Workflow Orchestration Manager
    • Configuration management
    • Connect to One Lake Storage
    • Library management
    • Submit and manage jobs
    • Use Delta Lake scenario in Azure HDInsight on AKS cluster
    • Use ML Notebook on Spark
    • Use Hive metastore
• Resources
  • FAQ
  • Subscribe to release notes GitHub repo
  • Pricing calculator
  • Support options
  • Trademarks
  • Troubleshoot
    • Cluster creation errors