Questions tagged [data-flow]
The data-flow tag has no usage guidance.
7
questions
0
votes
1
answer
28
views
The debugger only stops at the breakpoints of the first Script Component. How do I debug more than one Script Component in an SSIS Data Flow Task?
This takes up How to debug a script component in SSIS - Stack Overflow which was asked for the 2008 version and is now outdated. That is why this question needs to be revived for the versions of ...
- 316
0
votes
0
answers
90
views
Fastest Mechanism: Monitor new record being added to MySQL DB, and push info via WebSocket/SSE?
I have a MySQL DB on MaridDB.
There's a table that gets new records inserted at inconsistent intervals. sometimes every seconds, sometimes every few minutes.
I have a web page and instead of having ...
- 101
0
votes
1
answer
470
views
How do you detect a change in grouping when using Partition By in SQL Server 2012+ and execute logic based upon the change in the same SQL statement?
If I have a SQL statement that contains something like,
ROW_NUMBER() OVER(PARTITION BY school_area ORDER BY school_area)
I get:
1 someschool1 schoolarea1
2 someschool2 schoolarea1
3 someschool3 ...
0
votes
1
answer
463
views
Power BI refresh dataflow keep a snapshot of data
my requirement is to be able to save the past state of an entity at a certain point of time. Currently when the dataflow is refreshed, the past state is lost and only the current one is displayed. Is ...
- 1
3
votes
1
answer
500
views
SSIS Merge Join: Delete does not work
I've set up a Data Flow Task to sync a flat file with its destination table using a Merge Join with a Left Outer Join as described here (and elsewhere).
Merge Join:
Inserting and Updating works fine,...
- 317
0
votes
1
answer
5k
views
SSIS - Disable Task Based on Variable Value
I have an SSIS package that runs a number of Data Flow Tasks all at the same time.
Each Data Flow Task is placed inside a Sequence Container.
Before the Data Flow Tasks are run, a Script Task is ...
- 533
2
votes
1
answer
28
views
How is SSDT Data Flow batching handled?
How does SSDT handle batching of Data Flow tasks?
I am parsing a CSV that is about 1GB into SQL Server using SSDT.
In the Data Flow there is a Flat File source, that goes to an OLE DB destination (a ...
- 2,390