Data Solution Architect/ Engineering Manager at Cognizant| Snowflake SnowPro Certified| AWS Developer Certified.
Snowflake Data Governance Framework by Abhijit Debnath 5 Minutes read
Skip to main content
Data Solution Architect/ Engineering Manager at Cognizant| Snowflake SnowPro Certified| AWS Developer Certified.
Snowflake Data Governance Framework by Abhijit Debnath 5 Minutes read
To view or add a comment, sign in
Data Solution Architect/ Engineering Manager at Cognizant| Snowflake SnowPro Certified| AWS Developer Certified.
Data Migration and Replication to Oracle-->S3-->Snowflake using DMS: ------------------------------------------------------------------------------- If you’re considering migrating and replicating data from Oracle to Snowflake using DMS, it is essential to know the pros and cons of both the LogMiner and Binary Reader approaches. LogMiner: LogMiner is an SQL utility provided by Oracle that accesses both online and archived redo logs. It is commonly used for change data capture (CDC) in Oracle databases. While LogMiner offers several advantages, such as providing detailed information about changes (including SQL statements) and being useful for historical data analysis, it also has several disadvantages when compared to the Binary Reader approach. Binary Reader: Binary Reader is an AWS DMS feature that directly reads and parses the redo logs without using LogMiner. LogMiner Vs Binary Reader: 1. If you planning for high volume data changes then go for Binary Reader as it has lower impact on the Oracle source during migrations with a high volume of changes. 2. Binary Reader performs better with CDC for high volume changes compared to LogMiner. 3. Binary Reader supports CDC for LOB columns in Oracle while LogMiner does not support CDC if you are using Oracle 12C. 4. Binary Reader has less limitation on table char length and column char length. Currently, log miner has the limitation if the table char length or column char length is more than 30. How to Enable Binary Reader: It should be enabled at the endpoint level of DMS task. In extra connection attribute add below to enable it useLogminerReader=N;useBfile=Y In summary, choose LogMiner when you need detailed information and historical analysis, but consider Binary Reader for high volume migrations with minimal impact on the Oracle source. If you are dealing with large volume migrations, Binary Reader might be the better choice.
To view or add a comment, sign in
Data Solution Architect/ Engineering Manager at Cognizant| Snowflake SnowPro Certified| AWS Developer Certified.
If you’re in the process of selecting a distributed database, the following comparison matrix may be of assistance. It features three databases—YugabyteDB, Amazon Aurora, and CockroachDB—which have recently gained significant traction in various industries. The comparison I created below mainly aims to provide a clear distinction between YugabyteDB, Amazon Aurora, and CockroachDB. YugabyteDB Vs Aurora Vs CockroachDB Note: Below is the snapshot from my excel.
To view or add a comment, sign in
Data Solution Architect/ Engineering Manager at Cognizant| Snowflake SnowPro Certified| AWS Developer Certified.
Have you tried Snowflake’s forecasting model? It’s user-friendly and straightforward. If you haven’t, let me provide a quick example. I created a basic time series table and applied the model to it. Here are the steps I followed to obtain a 99% accurate forecast for the next 10 days(Till 19th May). You can adjust the accuracy percentages as needed. Additionally, you can pass the query directly instead of using a view. drop table forecasting_test; create table forecasting_test(Product_count number, date_series timestamp_ntz(9)); insert into forecasting_test select UNIFORM(1, 10::NUMBER(10, 2), RANDOM()) PRODUCT_COUNT, dateadd( day, '-' || row_number() over (order by null), dateadd(day, '+1', current_date()) ) as date from table (generator(rowcount => 90)); select * from forecasting_test; GRANT USAGE ON DATABASE <DATABASE_NAME> TO ROLE ACCOUNTADMIN; GRANT USAGE ON SCHEMA <DATABASE_NAME>.<SCHEMA_NAME> TO ROLE ACCOUNTADMIN; GRANT CREATE SNOWFLAKE.ML.FORECAST ON SCHEMA <DATABASE_NAME>.<SCHEMA_NAME> TO ROLE ACCOUNTADMIN; ALTER ACCOUNT SET search_path='$current, $public, snowflake.ml'; show parameters like '%autocommit%' ; alter session set autocommit=TRUE; create or replace view vw_forecasting_test as select * from forecasting_test order by 2 desc; select * from vw_forecasting_test; describe view vw_forecasting_test; show snowflake.ml.forecast; create or replace snowflake.ml.forecast mdl_forecasting_test ( input_data => SYSTEM$REFERENCE('VIEW', 'vw_forecasting_test'), timestamp_colname => 'DATE_SERIES', target_colname => 'PRODUCT_COUNT' ); call <DATABASE_NAME>.<SCHEMA_NAME>.mdl_forecasting_test!forecast( forecasting_periods => 10, config_object => {'prediction_interval': 0.999} ); #HappyLearning
To view or add a comment, sign in
Data Solution Architect/ Engineering Manager at Cognizant| Snowflake SnowPro Certified| AWS Developer Certified.
It takes immense excitement as I post this, to extend my heartfelt thanks to Snowflake for inviting me to the snowflake data for breakfast Toronto event, today. It was an absolute pleasure to be part of such an engaging and informative gathering. The combination of insightful discussions and delightful breakfast offerings made an incredible experience. I thoroughly enjoyed the opportunity to have a chat with industry leaders and fellow tech enthusiasts about the latest trends and developments. The event has left me feeling inspired and excited about the endless possibilities that Snowflake data presents. Thank you once again for organizing this fantastic event. I eagerly anticipate future opportunities to continue our exploration in this fascinating field. Snowflake Cognizant #SharedInvestigatorPlatform #DataForBreakfast #Toronto
To view or add a comment, sign in
Data Solution Architect/ Engineering Manager at Cognizant| Snowflake SnowPro Certified| AWS Developer Certified.
Well done. Proud of you
Recently I came across a medical condition named Syncope in which a patient frequently passes out and faints, as a solution I introduce my new APP Syncope Cure through which a person can fight against it at least to some extent. This condition is more fatal when they step outside and there might be a chance that they get fainted, this APP will let their near ones know if such a scenario has happened by means of a response system. ✅There is a buzzer alert that has to be set by the user on the parameter of time; when the time will elapse, a ring and vibrate alert will generate. The user will have 30 seconds(Customizable) to hit on the snooze option. If he fails to do that, then a notification text will be received by the number (which he has chosen before setting the alert period) in which there will be his accurate present location as there might be a higher chance that he got fainted as he did not respond to the alert ring and vibration. ✅Moreover, there is an additional SAY YOU ARE OK option given by taking into consideration of the fact that the user just failed to click on snooze by a fraction of a second, The click on SAY YOU ARE OK will quickly give a response text that the user is fine so that his near ones doesn’t have to worry. ✅Additionally, it has a business model in which the doctors will pay the developer for posting their consulting contact and patients who are in need of the doctor will click on BOOK APPOINTMENT which will redirect to the phone number of the medical clinic. ✅The alarm sound will not stop untill the snooze or send sms option clicked or the app is terminated. If you are watching the video please keep the volume high when the popup alert will come. #medical #technology #softwareengineering #androiddevelopment #java #AIIMS #programming #android #syncope #softwaredesign #computerscience #innovation #healthcare #health #who #xml #sql #firebase #developer #doctors #mobileappdevelopment #mobileapplications #cse #computerscienceengineering #share
To view or add a comment, sign in
Abhijit Debnath reposted this
Recently I came across a medical condition named Syncope in which a patient frequently passes out and faints, as a solution I introduce my new APP Syncope Cure through which a person can fight against it at least to some extent. This condition is more fatal when they step outside and there might be a chance that they get fainted, this APP will let their near ones know if such a scenario has happened by means of a response system. ✅There is a buzzer alert that has to be set by the user on the parameter of time; when the time will elapse, a ring and vibrate alert will generate. The user will have 30 seconds(Customizable) to hit on the snooze option. If he fails to do that, then a notification text will be received by the number (which he has chosen before setting the alert period) in which there will be his accurate present location as there might be a higher chance that he got fainted as he did not respond to the alert ring and vibration. ✅Moreover, there is an additional SAY YOU ARE OK option given by taking into consideration of the fact that the user just failed to click on snooze by a fraction of a second, The click on SAY YOU ARE OK will quickly give a response text that the user is fine so that his near ones doesn’t have to worry. ✅Additionally, it has a business model in which the doctors will pay the developer for posting their consulting contact and patients who are in need of the doctor will click on BOOK APPOINTMENT which will redirect to the phone number of the medical clinic. ✅The alarm sound will not stop untill the snooze or send sms option clicked or the app is terminated. If you are watching the video please keep the volume high when the popup alert will come. #medical #technology #softwareengineering #androiddevelopment #java #AIIMS #programming #android #syncope #softwaredesign #computerscience #innovation #healthcare #health #who #xml #sql #firebase #developer #doctors #mobileappdevelopment #mobileapplications #cse #computerscienceengineering #share
To view or add a comment, sign in
Abhijit Debnath reposted this
I do believe in solving real life problem by means of programming, and hence, I have build this app name Tuition Quest which will enable all the Person/Coaching who are willing to teach in online or offline mode. They can post their credential and registered student can easily reach out them. It will essentially help such students who are looking for a doubt solving mentor rather than a Teacher. Student can search their needful course in the Search Menu and can request for a quick callback from the teacher. I have used JAVA backend with SQL and Firebase Implementation. This also has animation such as splash screen. I have designed the Logo by myself and all the Images used here are also designed by me in Adobe XD Looking Forward for posting it to Playstore for helping the Student for connecting with their doubt solving mentor or Teacher . #javaprogramming #androiddeveloper #androiddev #androidstudio #sql #firebase #jis #javaprogramming #java #btech #computerscience #androidapplication #appdeveloper #coaching #students #tuition #teacher #programming #adobexd
To view or add a comment, sign in
Data Solution Architect/ Engineering Manager at Cognizant| Snowflake SnowPro Certified| AWS Developer Certified.
Kshouni Chakrabarti #Kudos I just wanted to say #ThankYou
To view or add a comment, sign in