Questions tagged [data-warehouse]
The data-warehouse tag has no usage guidance.
33
questions
-2
votes
1
answer
85
views
What is a route I could take when considering setting up a data warehouse for a small business? [closed]
I am working for a medium-sized development and construction company and we are looking to upgrade our data and BI. Currently, all project data is managed via Excel (data, project management, and ...
0
votes
3
answers
221
views
In data engineering, why is data integrity checked on the DW rather than on the data sources?
I'm a software developer and new to data engineering, so this may be a newbie question, but I'm wondering why data integrity checks (for instance, dbt tests) are ran on the data warehouse, rather than ...
- 243
0
votes
0
answers
42
views
Using cloud data warehouse as back-end for website
I am building a website, where the main data source is Snowflake, a cloud data warehouse.
This cannot be changed, but we can add other technologies.
There is a lot of data in Snowflake, and the ...
- 101
-2
votes
2
answers
405
views
What happens after the ETL process?
I have thousands of .csv files with the same structure and, in most of the cases, some column values are the same ones recurring. Each file represents a report on some structures, with numeric ...
0
votes
1
answer
95
views
Attributes at the fact table in dimensional data model
I know that a fact table in dimensional data model consists of measures and flags for an event or transaction. I also understand that it may contain date of the event. I have to design on fact table ...
0
votes
1
answer
352
views
How to keep a data warehouse updated?
Suppose there is a system ( like an ERP ) that writes to a database ( not too big, less than 100GB ). You need to export the data from this database to a data warehouse ( like RedShift or BigQuery ) ...
- 183
0
votes
1
answer
268
views
Do Data Warehouse standards allow foreign key constraints at a dimensional model?
Is it true that we never enable foreign key constraints in the dimensional model of a data warehouse? If yes, then what is the rationale behind that?
As per my research:
Some experts told me in a ...
- 33
-3
votes
1
answer
86
views
what is event based data integration? [closed]
Please help me to understand what is event based data integration in simple layman term with some examples?
How it is different from other form of data integration.
Some sample use cases will be ...
4
votes
2
answers
995
views
How should a data warehouse be maintained for a quickly changing schema
I am currently in a process of maintaining a data warehouse for a quickly growing start up company. There is a lot of reporting demands from the clients, and this is usually handled by a data ...
- 151
1
vote
1
answer
762
views
Load for Date dimension table of a warehouse
I have a general question about loading data into a data warehouse (DW).
This is basically a followup to an older question of mine.
I have a general understanding problem about fill the [Date] ...
- 159
3
votes
2
answers
152
views
Enterprise application warehousing and relational database
I have a general question about design pattern for an enterprise application.
I read a lot about it but its actually hard to find an answer because most you find it rater about how to design a data ...
- 159
1
vote
3
answers
142
views
How to make a data warehouse of a single full Database?
After learning about the data warehouse concepts whole day, I couldn't found a source that can actually say when you should not do data warehousing. In most tutorials I read, it says that DW is for ...
- 119
0
votes
1
answer
97
views
Lightweight data mining + organization & visualization
I'm looking to do some simple data mining that consists of going once per day to a single page and collect the following information:
List of movie theaters
Movies today on each theater
Session times ...
- 11
2
votes
1
answer
799
views
Indexes on a SQL Server fact table
If I have a SQL Server fact table with four dimensions (OrderDate, Customer, Product, Region), my understanding is that it's best to create a non-clustered index per foreign key (dim key column in the ...
- 23
26
votes
8
answers
2k
views
Is there a programming paradigm that promotes making dependencies extremely obvious to other programmers?
I work in a Data Warehouse that sources multiple systems via many streams and layers with maze-like dependencies linking various artifacts. Pretty much every day I run into situations like this: I run ...
- 369