Azure Synapse Analytics
Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless or dedicated resources—at scale.
- Azure Synapse Analytics
- Switch to dedicated SQL pool formerly SQL DW >
- Overview
- Quickstarts
- Get started
- 1 Create a Synapse workspace
- 2 Analyze using serverless SQL pool
- 3 Analyze using a Data Explorer pool
- 4 Analyze using a serverless Spark pool
- 5 Analyze using a dedicated SQL pool
- 6 Analyze data in a storage account
- 7 Integrate with pipelines
- 8 Visualize with Power BI
- 9 Monitor
- 10 Explore the Knowledge center
- 11 Add an administrator
- Workspace
- What's the difference between Azure Synapse formerly SQL DW and Azure Synapse Analytics workspaces?
- Quickstarts
- Concepts
- Shared metadata management
- Overview
- Metadata objects
- Code artifacts
- Maintenance schedule
- Source control
- Continuous integration and delivery
- Security
- Security baseline
- Security Controls by Azure Policy
- Encryption
- Network Security
- Authentication and pass-through
- Access control
- Shared metadata management
- How-to guides
- Manage and Monitor
- Secure
- Manage access control
- Data exfiltration protection
- Manage private endpoints
- Troubleshoot
- Move workspace to new region
- Move workspace to another tenant
- Database templates
- Synapse SQL
- Overview
- Quickstarts
- Use serverless SQL pool
- Create a dedicated SQL pool using Synapse Studio
- Create a dedicated SQL pool using Azure portal
- Pause and resume using PowerShell
- Pause and resume using Azure portal
- Load data with dedicated SQL pools
- Workload management
- Scale compute using the Azure portal
- Scale compute using PowerShell
- Scale compute using T-SQL
- Create workload classifier
- Create workload isolation
- Tutorials
- Concepts
- Back up and restore
- Data ingestion and preparation
- Development
- Overview
- Best practices serverless SQL pool
- Best practices dedicated SQL pools
- Distribution Advisor
- Materialized view
- Ordered clustered columnstore index
- Result set caching
- Machine learning predictions
- Tables
- T-SQL language elements
- Querying
- Monitoring
- Security
- Workload management
- How-to guides
- Back up and restore
- Manage and monitor
- Ingest and prepare data
- Into the data warehouse
- Into the Data Lake
- Change management and deployment
- Query external data
- Overview
- Query CSV files
- Query Parquet files
- Query JSON files
- Query nested types
- Query Delta Lake
- Query folders and multiple files
- Query partitioned files using file metadata
- Create and use views
- Create and use external tables
- Store query results to storage
- Query Parquet files and containers in Azure Synapse Link for Azure Cosmos DB
- Integrate
- Build data pipelines
- Connect with tools and applications
- Troubleshoot serverless SQL pools
- Data Explorer
- Overview
- Quickstarts
- Kusto Query Language
- Management commands
- Reference
- Apache Spark
- Apache Spark overview
- Quickstarts
- Tutorials
- Concepts
- Apache Spark
- Apache Spark pool configurations
- GPU-accelerated Apache Spark pools deprecated
- Delta Lake
- Optimize Apache Spark writes on Delta Lake
- Low Shuffle Merge on Delta Lake
- Apache Spark autoscale behavior
- Intelligent Cache
- Azure Synapse runtimes for Apache Spark
- Machine learning
- Notebooks
- Package management
- Monitor Apache Spark applications
- How-to guides
- Work with Delta Lake
- Manage packages
- Use notebooks and IDE tools
- Explore languages
- Security
- Optimize performance
- Manage and monitor
- Navigate the Apache Spark pool history server
- Monitor Spark applications
- Monitor Apache Spark pools
- Collect Apache Spark applications metrics using APIs
- Monitor Apache Spark Applications metrics with Prometheus and Grafana
- Monitor your Apache Spark applications with Azure Log Analytics
- Collect Apache Spark applications logs and metrics with Azure Storage account
- Collect Apache Spark applications logs and metrics with Azure Event Hubs
- Manage Apache Spark configuration
- Apache Spark Advisor
- Data sources
- Synapse Link
- Overview
- Quickstarts
- Concepts
- Azure Cosmos DB
- SQL Database
- SQL Server 2022
- Dataverse
- How-to guides
- Azure Cosmos DB
- Configure Synapse Link
- Connect to Azure Synapse Link for Azure Cosmos DB
- Synapse Link and integrated Power BI
- Use Power BI and serverless SQL pool to analyze Azure Cosmos DB
- Query Azure Cosmos DB analytical store with Apache Spark 3
- Query Azure Cosmos DB analytical store with Apache Spark 2
- Copy data from Synapse Link into a dedicated SQL pool using Apache Spark
- Query Azure Cosmos DB analytical store with serverless SQL pool
- SQL Database
- SQL Server 2022
- Dataverse
- Azure Cosmos DB
- Pipeline and data flow
- Quickstarts
- Concepts
- Pipeline and activity
- Linked services
- Datasets
- Execution and trigger
- Integration runtime
- Differences from Azure Data Factory
- Data flows
- How-to guides
- Author
- Connectors
- Connector overview
- Amazon Marketplace Web Service Deprecated
- Amazon RDS for Oracle
- Amazon RDS for SQL Server
- Amazon Redshift
- Amazon S3
- Amazon S3 Compatible Storage
- AppFigures
- Asana
- Avro format
- Azure Blob Storage
- Azure AI Search
- Azure Cosmos DB for NoSQL
- Azure Cosmos DB for MongoDB
- Azure Data Explorer
- Azure Data Lake Storage Gen1
- Azure Data Lake Storage Gen2
- Azure Database for MariaDB
- Azure Database for MySQL
- Azure Database for PostgreSQL
- Azure Databricks Delta Lake
- Azure File Storage
- Azure SQL Database
- Azure SQL Managed Instance
- Azure Synapse Analytics
- Azure Table Storage
- Binary format
- Cassandra
- Common Data Model format
- Concur
- Couchbase
- data.world
- Dataverse
- DB2
- Delimited text format
- Drill
- Dynamics 365
- Dynamics AX
- Dynamics CRM
- Excel format
- File System
- FTP
- GitHub
- Google AdWords
- Google BigQuery
- Google Cloud Storage
- Google Sheets
- Greenplum
- HBase
- HDFS
- Hive
- HTTP
- HubSpot
- Impala
- Informix
- Jira
- JSON format
- Magento
- MariaDB
- Marketo
- Microsoft Access
- MongoDB
- MongoDB Atlas
- MySQL
- Netezza
- OData
- ODBC
- Office 365
- Oracle
- Oracle Cloud Storage
- Oracle Eloqua
- Oracle Responsys
- Oracle Service Cloud
- ORC format
- Parquet format
- PayPal
- Phoenix
- PostgreSQL
- Presto
- Quickbase
- QuickBooks Online
- REST
- Salesforce
- Salesforce Service Cloud
- Salesforce Marketing Cloud
- SAP Business Warehouse Open Hub
- SAP Business Warehouse MDX
- SAP Cloud for Customer
- SAP ECC
- SAP HANA
- SAP Table
- ServiceNow
- SFTP
- SharePoint Online List
- Shopify
- Smartsheet
- Snowflake
- Spark
- SQL Server
- Square
- Sybase
- TeamDesk
- Teradata
- Twilio
- Vertica
- Web Table
- Xero
- XML format
- Zendesk
- Zoho
- Move data
- Transform data
- Execute Data Flow activity
- Synapse notebook activity
- Synapse SQL pool stored procedure activity
- Azure Function activity
- Custom activity
- Databricks Jar activity
- Databricks Notebook activity
- Databricks Python activity
- Data Explorer Command activity
- Data Lake U-SQL activity
- HDInsight Hive activity
- HDInsight MapReduce activity
- HDInsight Pig activity
- HDInsight Spark activity
- HDInsight Streaming activity
- Machine Learning execute pipeline activity
- Machine Learning Studio classic batch execution activity
- Machine Learning Studio classic update resource activity
- Stored procedure activity
- Script activity
- Compute linked services
- Control flow
- Data flow transformations
- Parameterize
- Manage and monitor
- Create integration runtime
- Create triggers
- Troubleshooting guide
- Activity troubleshooting
- Connector troubleshooting
- Overview and general copy activity errors
- Azure Blob Storage
- Azure Cosmos DB including SQL API
- Azure Data Explorer
- Azure Data Lake Gen1 and Gen2
- Azure database for PostgreSQL
- Azure files
- Azure Synapse Analytics, Azure SQL Database, and SQL Server
- Azure Table Storage
- DB2
- Delimited text format
- Dynamics 365, Dataverse Common Data Service, and Dynamics CRM
- FTP, SFTP and HTTP
- Hive
- Oracle
- ORC format
- Parquet format
- REST
- SAP Table, SAP Business Warehouse Open Hub, and SAP ODP
- SharePoint Online list
- Snowflake
- XML format
- Continuous Integration and Deployment
- Security and access control
- Self-hosted Integration Runtimes troubleshooting
- Machine Learning
- Overview
- Quickstarts
- Use a sample notebook from the gallery
- Use the Retail AI solution
- Create a linked service
- Concepts
- Tutorials
- Data access and preparation
- Train a model
- With Apache Spark MLlib
- With automated machine learning deprecated
- With Horovod and Petastorm deprecated
- Score a model
- Data Catalog and Governance
- How-to
- Guidance
- Azure Synapse Success by Design
- Introduction
- Synapse proof of concept playbook
- Synapse implementation success methodology
- Overview
- Assess environment
- Evaluate workspace design
- Evaluate data integration design
- Evaluate dedicated SQL pool design
- Evaluate serverless SQL pool design
- Evaluate Spark pool design
- Evaluate project plan
- Evaluate solution development environment design
- Evaluate team skill sets
- Perform operational readiness review
- Perform user readiness and onboarding plan review
- Perform monitoring review
- Migration guides
- All migration guides
- Migrate to a dedicated SQL pool
- From Teradata
- From Netezza
- From Oracle
- Security white paper
- Azure Synapse Success by Design
- Reference
- Resources