Azure Stream Analytics documentation

Azure Stream Analytics is a fully managed, real-time analytics service designed to help you analyze and process fast moving streams of data that can be used to get insights, build reports or trigger alerts and actions. Learn how to use Azure Stream Analytics with our quickstarts, tutorials, and samples.

• Azure Stream Analytics documentation
• Overview
  • Welcome to Stream Analytics
• Quickstarts
  • Create a job
    • Azure portal
    • Visual Studio Code
    • Azure CLI
    • Bicep
    • ARM template
    • Terraform
    • PowerShell
  • Create a cluster
    • Azure portal
  • Build an End-to-End streaming application
• Tutorials
  • Capture Event Hubs data in Parquet format
  • Write output data to delta table in ADLS Gen2
  • Build real-time dashboards with no code editor
  • Visualize fraudulent calls in Power BI
  • Integrate third party services using Azure Functions
  • Create a custom .NET deserializer
  • Create an IoT Edge job
• Samples
  • Code samples
    • .NET
    • Java
    • JavaScript and TypeScript
    • Python
• Concepts
  • Stream Analytics resource model
    • Overview of resource model
    • Stream Analytics Cluster
  • End-to-end solution patterns
  • Choose a streaming analytics technology
  • Choose a job development tool
  • Develop locally
  • Security
    • Connect jobs to Azure Virtual Network VNet
    • Security controls by Azure Policy
    • Security baseline
  • Integrate with Schema Registry
  • Input types for a job
    • Inputs overview
    • Streaming data inputs
    • Reference data inputs
    • Kafka input
    • Validate input schema
    • Read inputs in any format using custom deserializers
  • Output types for a job
    • Outputs overview
    • Azure SQL Database
      • SQL Database output overview
      • SQL Database output performance
    • Azure Synapse Analytics
    • Azure Blob Storage & Azure Data Lake Gen2
      • Azure Blob and Data Lake output overview
      • Write data to Delta Lake
      • Custom path patterns
    • Azure Event Hubs
    • Power BI
    • Azure Cosmos DB
      • Azure Cosmos DB output overview
      • Azure Cosmos DB optimization
    • Azure Data Explorer
    • Azure Database for PostgreSQL
    • Table storage
    • Service Bus queues
    • Service Bus topics
    • Azure Functions
    • Kafka output
  • Extend queries with functions
    • Functions overview
    • JavaScript UDF
    • JavaScript UDA
    • C# UDF
    • Machine learning UDF
    • Debug UDFs
  • Optimize your Stream Analytics job
    • Understand and adjust Streaming Units
    • Improve query performance
    • Repartition your input
    • Increase throughput of your job
  • No code editor
  • IoT Edge
  • States of a job
  • Window functions
  • Geospatial functions
  • Compatibility level
  • Common query patterns
  • Parse JSON and AVRO data
  • Parsing Protobuf
  • Event ordering
    • Event ordering overview
    • Time handling considerations
  • Checkpoint and replay
  • Job diagram
  • Error policy
• How-to guides
  • Develop jobs
    • Test query
    • Start a job
    • Stop or delete a job
    • Autoscale jobs
    • Add SQL Database as output
    • Use SQL reference data
    • Update credentials
  • Manage jobs
    • Copy or back up a job
    • Pair jobs for reliability
    • Geo-redundancy
    • Encrypt your data CMK
  • Manage Stream Analytics clusters
    • Create and delete private endpoints
    • Add and remove jobs
    • Scale cluster size
    • Move cluster to another region
  • Build with no code editor
    • Build real-time dashboard with Power BI dataset
    • Capture Event Hubs data in Delta Lake format
    • Capture Event Hubs data in Parquet format
    • Materialize data to Azure Cosmos DB
    • Filter and ingest Synapse SQL data
    • Filter and ingest to Data Lake Storage Gen2
    • Enrich data and ingest to event hub
    • Transform and ingest to SQL database
    • Filter and ingest to Azure Data Explorer
  • Authenticate with managed identity
    • Managed Identities Overview
    • User Assigned Managed Identities
    • Azure Blob Storage & Azure Data Lake Gen2
    • Azure Cosmos DB
    • Azure Data Explorer
    • Azure Event Hubs
    • Power BI
    • Azure SQL DB & Azure Synapse Analytics
    • Service Bus
  • Build solutions
    • X sentiment analysis
    • Run jobs on Azure Stack
    • Toll booth sensor data analysis
    • High-frequency trading
    • Process IoT streaming data
    • Threshold-based rules
    • Update or merge in a SQL Database with Azure Functions
    • Process Kafka events
    • Process Event Hubs data
    • Process Azure SQL Database
    • Geospatial scenarios
  • Monitor
    • Monitor Stream Analytics
    • Monitoring data reference
    • Monitor jobs - Azure portal
    • Monitor jobs - PowerShell
    • Monitor jobs - Azure .NET SDK
    • Configure alerts
    • Use activity and resource logs
  • Optimize jobs
    • Job simulation
    • Physical job diagram
    • Logical job diagram
  • Automate
    • Using PowerShell for auto pausing
    • Using .NET SDK for management
    • Using API for IoT Edge jobs
    • Export and deploy with Azure Resource Manager
  • CI/CD
    • CI/CD overview
    • Build, test, and deploy with PowerShell
    • Set up a pipeline with Azure DevOps
    • Set up a pipeline using GitHub Actions
    • Deploy jobs with Bicep
    • Configure autoscale settings
  • Visual Studio Code
    • Export and manage jobs
    • Test locally with live data
    • Complete code with IntelliSense
    • Run jobs locally with VS Code
    • Test locally with sample data
    • Debug queries using job diagram
    • Create and debug .NET custom deserializer
    • JobConfig.json fields
  • Visual Studio
    • Migrate to VS Code
    • Quickstart
    • Test locally with sample data
    • Test locally with live data
    • View jobs in Visual Studio
    • Monitor jobs in Visual Studio
    • Debug queries using job diagram
    • Create a custom .NET deserializer
    • Develop an edge job
    • Run a C# UDF
    • Set up CI/CD pipeline
  • Troubleshoot
    • Input
    • Output
    • Query logic
    • Watermark delay increase
    • Data errors
    • Error codes
      • Configuration errors
      • Data errors
      • External availability errors
      • External errors
      • Internal errors
  • Integrate with Machine Learning
    • Sentiment analysis with ML models
    • Anomaly detection
    • Use ML REST APIs
  • Scale with ML functions
  • Run job in your virtual network
  • Connect to confluent cloud kafka
    • Connect to confluent cloud kafka as input
    • Connect to confluent cloud Kafka as output
• Stream Analytics Query Language
  • Stream Analytics Query Language overview
  • Built-in Functions
    • Built-in Functions Overview
    • Aggregate Functions
      • Aggregate Functions Overview
      • AVG
      • COUNT
      • Collect
      • CollectTOP
      • MAX
      • MIN
      • Percentile_Cont
      • Percentile_Disc
      • STDEV
      • STDEVP
      • SUM
      • TopOne
      • VAR
      • VARP
    • Analytic Functions
      • Analytic Functions Overview
      • AnomalyDetection_SpikeAndDip
      • AnomalyDetection_ChangePoint
      • ISFIRST
      • LAG
      • LAST
    • Array Functions
      • Array Functions Overview
      • GetArrayLength
      • GetArrayElement
      • GetArrayElements
    • Bitwise Operators
      • Bitwise Operators Overview
      • Bitwise AND
      • Bitwise OR
      • Bitwise XOR
      • Bitwise NOT
    • Conversion Functions
      • Conversion Functions Overview
      • CAST
      • GetType
      • TRY_CAST
    • Date and Time Functions
      • Date and Time Functions Overview
      • DATEADD
      • DATEDIFF
      • DATENAME
      • DATEPART
      • DATETIMEFROMPARTS
      • DAY
      • MONTH
      • YEAR
    • GeoSpatial Functions
      • GeoSpatial Functions Overview
      • CreateLineString
      • CreatePoint
      • CreatePolygon
      • ST_DISTANCE
      • ST_OVERLAPS
      • ST_INTERSECTS
      • ST_WITHIN
    • Input Metadata Functions
      • Input Metadata Functions Overview
      • GetMetadataPropertyValue
    • Mathematical Functions
      • Mathematical Functions Overview
      • ABS
      • CEILING
      • EXP
      • FLOOR
      • POWER
      • ROUND
      • SIGN
      • SQUARE
      • SQRT
    • Record Functions
      • Record Functions Overview
      • GetRecordProperties
      • GetRecordPropertyValue
    • String Functions
      • String Functions Overview
      • CHARINDEX
      • CONCAT
      • CONCAT_WS
      • LEFT
      • LEN
      • LOWER
      • LTRIM
      • NCHAR
      • PATINDEX
      • REGEXMATCH
      • REPLACE
      • REPLICATE
      • REVERSE
      • RIGHT
      • RTRIM
      • SPACE
      • STUFF
      • SUBSTRING
      • TRANSLATE
      • TRIM
      • UNICODE
      • UPPER
    • Windowing Functions
      • Windowing Functions Overview
      • Hopping Window
      • Session Window
      • Sliding Window
      • Snapshot Window
      • Tumbling Window
      • Aggregate Windowing functions
  • Data Types
    • Data Types Overview
    • Parsing JSON and AVRO data
    • Parsing Protobuf
  • Query Language Elements
    • Query Language Elements Overview
    • APPLY
    • CASE
    • COALESCE
    • CREATE TABLE
    • FROM
    • GROUP BY
    • HAVING
    • INTO
    • JOIN
    • MATCH_RECOGNIZE
    • NULLIF
    • Reference Data JOIN
    • SELECT
    • UNION
    • WHERE
    • WITH
  • Time Management
    • Time Management Overview
    • System.Timestamp
    • TIMESTAMP BY
    • Time Skew Policies
  • Event Delivery Guarantees
• Reference
  • Azure PowerShell
  • .NET
  • REST
  • Resource Manager template
  • Azure CLI
  • Azure Policy built-ins
• Resources
  • Stream Analytics previews
  • Azure Roadmap
  • [Blog](https://techcommunity.microsoft.com/t5/analytics-on-azure/bg-p/AnalyticsonAzure/label-name/Azure Stream Analytics)
  • Feedback forum
  • Microsoft Q&A question page
  • Pricing
  • Pricing calculator
  • Service updates
  • Stack Overflow
  • Videos
  • Customer case studies