Sharing and Deploying Data Science with KNIME Server
•
2 likes•1,311 views
You’re currently using the open source KNIME Analytics Platform, but looking for more functionality - especially for working across teams and business units? KNIME Server is the enterprise software for team based collaboration, automation, management, and deployment of data science workflows, data, and guided analytics. Non experts are given access to data science via KNIME Server WebPortal or can use REST APIs to integrate workflows as analytic services to applications, IoT, and systems. These slides are from a webinar where we introduce all KNIME Server features. It covers everything you need to manage your analytics at scale - deploying your workflows for sharing and collaboration, scheduling and automating tasks, templating and version control, as well as enterprise integration. it highlights the power of the REST API of KNIME Server, and the KNIME WebPortal - the ideal way for bringing data analytics to your non experts. View the webinar at: https://www.youtube.com/watch?v=qFV4P9-enZk
Report
Share
Sharing and Deploying Data Science with KNIME Server
- 1. © 2019 KNIME AG. All rights reserved. Webinar: Sharing and Deploying Data Science with KNIME Server Roland Burger Data Scientist KNIME
- 2. © 2019 KNIME AG. All rights reserved. 2 KNIME Server • Collaboration – Share Expertise and Templates/Blueprints • Automation – Schedule, Monitor, Update • Deployment – To Humans: Analytical Applications (“Guided Analytics”) – To Machines: via REST and custom APIs • Management – Manage distributed setups – Integrate with existing enterprise setup (authentication)
- 3. © 2019 KNIME AG. All rights reserved. 3 Challenges Operationalizing Data Science R&D MFG IT Marketing Sales … more Data Science Driven Applications Large, complex variety of technologies Providing skills and resources Continuous, high quality delivery Mainstreaming across the organization Creating Great Data Science
- 4. © 2019 KNIME AG. All rights reserved. 4 Challenges Operationalizing Data Science R&D MFG IT Marketing Sales … more Data Science Driven Applications Large, complex variety of technologies Providing skills and resources Continuous, high quality delivery Mainstreaming across the organization Productionizing Data Science
- 5. © 2019 KNIME AG. All rights reserved. 5 Better Decision-making, Faster! KNIME Integrations KNIME Analytics Platform KNIME Server Load > Integrate > Transform > Analyze > Visualize KNIME Extensions Community Extensions Partner Extensions Collaborate Automate Manage Deploy
- 6. © 2019 KNIME AG. All rights reserved. 6 KNIME Server Management Deployment Configuration & Versioning RESTful Services Client & User PreferencesSecurity Guided Analytic AppsWeb Front-ends Collaboration Workflow Hub Workflows Shared Repository, Versioning Metanodes, Nodes Data Automation Distributed Executors Remote, Client ControlProvisioning
- 7. © 2019 KNIME AG. All rights reserved. 7 KNIME Server Live Demo
- 8. © 2019 KNIME AG. All rights reserved. 19 Guided Analytics for ML/AI Automation • Interaction & Automation • Data Scientist’s Choice: right mix for target audience
- 9. 20© 2019 KNIME AG. All rights reserved.
- 10. 21© 2019 KNIME AG. All rights reserved.
- 11. 22© 2019 KNIME AG. All rights reserved.
- 12. © 2019 KNIME AG. All rights reserved. 23 KNIME Server REST API • Enables external integration • Build applications around KNIME Server • e.g. for Microservices and real time scoring Output in server responseInput data Deploy KNIME workflows as web services
- 13. © 2019 KNIME AG. All rights reserved. 24 KNIME Server REST API: Job Pool KNIME Workflow for e.g. sentiment prediction, churn score, chemical property Pre-loaded jobs pooled and waiting for work Workflow immediately executed External REST call No “load latency” for client Results Take from pool Pooled jobsKNIME Executor KNIME SERVER
- 14. © 2019 KNIME AG. All rights reserved. 31 Managing Preferences – local KNIME Analytics Platform KNIME Analytics Platform KNIME Analytics Platform How do I install database drivers? How do I configure Python? KNIME Website Internal knowledgebase
- 15. © 2019 KNIME AG. All rights reserved. 32 Managing Preferences – KNIME Server Marketing R&DFinance Linux and macOS Python R Windows 7 Oracle MS Access Windows 10 Hive Spark • Different departments/teams have different requirements • Multiple OS deployments • Windows 7 • Windows 10 • Linux • macOS
- 16. © 2019 KNIME AG. All rights reserved. 33 Managing Preferences – KNIME Server KNIME Server Profiles can include: Preferences, drivers, and more • Client-profiles • Python-Linux • Python-macOS • R-Linux • R-macOS • Databases-Win7 • Big Data-Win10 client-profiles Big Data- Win10 Databases- Win7 Python- macOS (etc) Marketing Finance R&D
- 17. © 2019 KNIME AG. All rights reserved. 34 Client Customization Profiles
- 18. © 2019 KNIME AG. All rights reserved. 35 KNIME Server – Admin made easy
- 19. © 2019 KNIME AG. All rights reserved. 36 Distributed Executors • Need more workflow horsepower? • KNIME Server currently supports ‘Scale Up’ • KNIME Server Distributed Executors allows ‘Scale Out’ https://upload.wikimedia.org/wikipedia/commons/thumb/8/8b/Server.svg/2000px-Server.svg.png https://upload.wikimedia.org/wikipedia/commons/5/53/Server-multiple.svg
- 20. © 2019 KNIME AG. All rights reserved. 37 Distributed Executors KNIME Server Executor 1 Executor 2 Executor 3 RabbitMQ KNIME Server + Distributed Executors Requests to execute workflows
- 21. © 2019 KNIME AG. All rights reserved. 38 Distributed Executors KNIME Server Executor 1 RabbitMQ KNIME Server + Distributed Executors Request to execute workflow Scripted launch on AWS CloudFormation
- 22. © 2019 KNIME AG. All rights reserved. 39 Distributed Executors KNIME Server Executor 1 Executor 2 RabbitMQ KNIME Server + Distributed Executors More requests to execute workflows Launching CPU load increases AWS Auto-scaling Group
- 23. © 2019 KNIME AG. All rights reserved. 40 Distributed Executors KNIME Server Executor 1 Executor 2 RabbitMQ KNIME Server + Distributed Executors Requests to execute workflows AWS Auto-scaling Group
- 24. © 2019 KNIME AG. All rights reserved. 41 KNIME Software – On premise and in the cloud KNIME Analytics Platform KNIME Server KNIME Analytics Platform KNIME Server KNIME Analytics Platform KNIME Server
- 25. © 2019 KNIME AG. All rights reserved. 42 KNIME Server Management Deployment Configuration & Versioning RESTful Services Client & User PreferencesSecurity Guided Analytic AppsWeb Front-ends Collaboration Workflow Hub Workflows Shared Repository, Versioning Metanodes, Nodes Data Automation Distributed Executors Remote, Client ControlProvisioning Ready to get started with KNIME Server? Contact us for a free trial: contact@knime.com
- 26. © 2019 KNIME AG. All rights reserved. 43 KNIME Spring Summit 2019 March 18 – 22 at bcc Berlin Congress Center, Berlin • Monday & Tuesday: One-day courses • Wednesday & Thursday: Summit sessions • Friday: Workshops Use the code WEBINAR-20 for 20% off tickets! Register at knime.com/spring-summit2019
- 27. 44© 2019 KNIME AG. All rights reserved. The KNIME® trademark and logo and OPEN FOR INNOVATION® trademark are used by KNIME AG under license from KNIME GmbH, and are registered in the United States. KNIME® is also registered in Germany.