Questions tagged [azure-synapse]
Questions about Azure Synapse Analytics, bringing together enterprise data warehousing and big data analytics.
azure-synapse
2,873
questions
0
votes
0
answers
33
views
Performance improvement: Azure Synapse stored procedure
I need suggestions on the stored procedure, it basically compares the live data with the backup data based on some condition(s).
So difference = (A-B) + (B-A)
Here's my attempt: my idea is to store ...
- 23
0
votes
0
answers
24
views
Synapse authentication error reading from ADLS gen2 when using trigger run
I have a notebook in azure synapse that I am using to read data from a storage account ADLS gen2. The notebook runs fine when I run it directly, but i get this error when I try to call the notebook ...
- 199
0
votes
0
answers
32
views
configuring CMK on synapse workspace getting the error Could not perform a 'Get' operation on the workspace encryption key
I have got a synapse workspace bicep code below, trying to add double encryption but currently faced with the error below.
key: {
name: 'default'
keyVaultUrl: 'https://my-kv.vault.azure.net/keys/...
- 825
2
votes
0
answers
39
views
Unexpected differing BINARY results in Azure Spark Notebook depending on magic code %%sql or %%pyspark
Hello stack overflow community,
I am currenty facing an issue in an Azure Synapse Analytics Spark Notebook that I do not understand and need help with (hint: The Spark version of the Apache Spark pool ...
- 21
0
votes
1
answer
34
views
azure synapse bicep code failing with the error Values for request parameters are invalid: keyvaultproperties.keyvaulturi
I have got a synapse workspace bicep code below, trying to add double encryption but currently faced with the error below.Tried different things to no avail, the issue here is that the code was ...
- 825
0
votes
0
answers
47
views
How to Assign Roles in Synapse to Restrict Data Access?
I'm working on a project in Synapse and need to assign roles to users such that certain people can see specific data while others cannot. Here's what I've tried so far:
Creating a role using the ...
- 83
0
votes
0
answers
67
views
Azure Data Factory Logging Values of data flow (metrics) makes no sense
I have a data flow which takes parquet from adls. Then takes the data in source activity then comes a derived column, then perform a aggregation (count) which join back (join activity/inner) to the ...
- 1
0
votes
1
answer
66
views
Azure Synapse Analytics - output not displayed
Following Scala code in Azure Synapse should print: Hello, World!. But instead, it prints: defined object Geeks.
Question: What could be the issue and how can we fix it?
object Geeks {
// Main ...
- 23.3k
0
votes
1
answer
46
views
SharepointList to Azure synapse
I am trying to create a copy activity in Azure synapse analytics that copies data from a SharePoint List. I already have an APP registered and a linked service created. My issue is that once the data ...
0
votes
0
answers
34
views
Power BI Reports, Azure Synapse link Data from D365 Finance and operations table display method
I am working on a Power BI report using Azure Synapse link to access tables from D365 finance and operations. I am running into scenario where certain fields that I need to recreate in the report are ...
0
votes
2
answers
85
views
Azure DevOps release pipeline has suddenly started failing
2024-07-09T23:11:19.7718791Z Complete getting Artifacts From Template
2024-07-09T23:11:19.7719155Z Start deploying artifacts from the template.
2024-07-09T23:11:19.7722609Z Deploy ...
- 47
0
votes
1
answer
38
views
Is there any way to parameterize the linked service name in a dataset in Azure Synapse Analytics?
I'm new to Azure Synapse Analytics and working with CI/CD pipelines. Currently, I'm exploring how to parameterize pipeline parameters. My current code does not have a template-parameters-definition....
- 1
0
votes
1
answer
40
views
ADF pipeline failure - session terminated due to failure on source side
I am working on a task that involves bulk copying of huge loads of data for six months which is around (2 billion records). I am using copy activity for copying the data from sql server and created ...
0
votes
1
answer
73
views
Load data from Delta table and write to Synapse dedicated SQL pool
I'm working on a project where we are trying to load multiple tables from Delta table into Synapse dedicated pool. The reason why we need the data in SQL is because the apps that read it are using ....
- 2,473
0
votes
1
answer
45
views
EventHub spark structured streaming using certificate authentication
I want to use structured streaming for EventHub message consumption using pyspark in Azure Synapse and I was pointed to this project https://github.com/alexott/databricks-playground/tree/main/kafka-...
- 73