Prafull Kotecha

Elasticsearch open inference API adds support for OpenAI chat completions. Learn more in this blog post: https://gag.gl/hEDnXw #ElasticSearchLabs #OpenAI

5

How To Build A Platform Engineering Environment On Kubernetes 👇 ✅ Part 1: https://buff.ly/3u58qhA Part one dives into building the cluster, automating the workflows, and securing the environment. ✅ Part 2: https://buff.ly/47NDG2k Part two dives into platform capabilities like monitoring, observability, and overall cluster management. ✅ Part 3: https://buff.ly/4939GRg Part three dives into various tools and platforms you can use to make platform engineering easier on Kubernetes. #kubernetes #devops #platformengineering

119

1 Comment

Yesterday's holiday (June 11, 2024) activity includes playing and learning RAG implementation with Elasticsearch (ELSER - Elastic Learned Sparse EncodeR, a natural language processing (NLP) model trained by Elastic) and E5 embeddings. The thought process includes crawling a public website using Elastic Web crawler, ingest and format the data in Elasticsearch index for these data to be use when asking question to openAI (LLM) - the result will then be displayed a webapp built using Streamlit ( a free and open-source framework to rapidly build and share machine learning and data science web apps). Sharing the resulting code for other to use and some screenshots of the questions and answers using openAI. RAG Implementation for your own experimentation: Giving credit where it's due Grant Patterson - thanks for sharing the initial code for me to play with.

17

✍ Some good recommendations in this post from #aws:- - Federate your GitHub users and manage the lifecycle of identities through a directory. https://lnkd.in/gxJxiH_S 👥 - Limit administrative privileges of GitHub repositories, and restrict who is able to administer permissions, write to repositories, modify repository configurations, or install GitHub Apps. https://lnkd.in/gxmS9-C8 🛡️ - Limit control over GitHub Actions runner registration and group settings. https://lnkd.in/gba6yJMr 🏃‍♂️ - Limit control over GitHub workflows, and follow GitHub’s recommendations on using third-party actions. https://lnkd.in/gNrwiHA8 🔄 - Do not allow public repositories access to self-hosted runners. https://lnkd.in/g564YC-s 🚫 #githubactions #security #bestpractise https://lnkd.in/gNfyWRa5

3

Despite the cloud popularity reports, I still believe GCP is the best option for containers and Kubernetes. For example - Cloud Run is a great container orchestrator by itself. It runs on top of Borg, so it has all of the scheduling and scaling capabilities. And because it’s running on Borg via Googles servers, you know the scale capacity exists. #kubernetes #devops #platformengineering

28

2 Comments

Dive into Kubernetes best practices and strategies for optimizing your deployment, scaling, and management. Maximize the potential of your system with Prabhakar Repalle's comprehensive guide: https://lnkd.in/e3HumtyK Learn how you can enhance the security, efficiency, and cost-effectiveness of your Kubernetes deployments! #Kubernetes #OKE #DevOps #Automation

17

10 Years of Kubernetes - on this anniversary, we've looked back at the beginnings, from the very first commit to the popularisation of containers, going through the history of not only Kubernetes but the entire cloud-native ecosystem and community. Milestones, challenges, growing pains, successes, and above an history of growing community involvement. Do give it a read, and happy KuberTENes :D https://lnkd.in/dDCBFaP4

25

Deploying an Apache Webserver on IBM Cloud - Intro to Terraform Interested in reducing provisioning times and minimizing errors in infrastructure deployment? Check out this blog guide on automating the deployment of a vanilla #Apache web server using Terraform and Ansible. Building automation around infrastructure deployment can bring efficiency and accuracy to your processes. Interested in learning more? Contact Jack Bernhardt Blog: https://ibm.biz/BdKsx4 #IBMCloud #InfrastructureAutomation #Terraform #Ansible #WebserverDeployment

19

Azure Functions are excellent for handling long-running and resource-intensive tasks. As a serverless computing platform from Microsoft Azure, it enables users to develop event-driven applications with ease. This platform offers on-demand infrastructure and resources, allowing users to focus on writing code in their preferred language rather than managing the underlying infrastructure. Watch my video below to learn how to integrate Copilot Studio with Azure Functions. #MicrosoftCopilot #CopilotStudio #Copilot #PowerPlatform #AI #PowerUser #Azure #Microsoft Microsoft Power Platform Community #GenAI #PVA

18

Do you know that Incomplete Multipart Uploads in S3 can also cost you money if you're not careful? There is a recent article by Maciej Poćwierz that talks about how AWS charges you for unauthorized requests to S3 buckets and how anyone can ramp up your AWS bill if they know your bucket name! Another somewhat similar but lesser-known problem is with S3 Incomplete Multipart Uploads which can cause an uptick in your AWS bill. S3 Multipart Upload is a feature that lets users upload large files to AWS S3 in smaller parts. Once all the parts are uploaded, S3 reassembles them into the original file. It helps with faster uploads and recovery in case of errors. The S3 Multipart Upload process involves the following steps 𝗜𝗻𝗶𝘁𝗶𝗮𝘁𝗲 𝗠𝘂𝗹𝘁𝗶𝗽𝗮𝗿𝘁 𝗨𝗽𝗹𝗼𝗮𝗱 (𝗖𝗿𝗲𝗮𝘁𝗲𝗠𝘂𝗹𝘁𝗶𝗽𝗮𝗿𝘁𝗨𝗽𝗹𝗼𝗮𝗱): - Starts the multipart upload process for a specific object in an S3 bucket. - Returns an upload ID used for subsequent API calls related to the upload. 𝗨𝗽𝗹𝗼𝗮𝗱 𝗣𝗮𝗿𝘁 (𝗨𝗽𝗹𝗼𝗮𝗱𝗣𝗮𝗿𝘁): - Uploads a specific part of the large object to S3. - Requires the upload ID obtained from CreateMultipartUpload. - Responds with an Entity Tag (ETag) for successful uploads. - Parts can be uploaded in parallel. 𝗖𝗼𝗺𝗽𝗹𝗲𝘁𝗲 𝗠𝘂𝗹𝘁𝗶𝗽𝗮𝗿𝘁 𝗨𝗽𝗹𝗼𝗮𝗱 (𝗖𝗼𝗺𝗽𝗹𝗲𝘁𝗲𝗠𝘂𝗹𝘁𝗶𝗽𝗮𝗿𝘁𝗨𝗽𝗹𝗼𝗮𝗱): - Assembles the uploaded parts into a complete object in S3. - Requires the upload ID and a list containing part number and ETag for each uploaded part. - Upon successful completion, the object becomes accessible in the S3 bucket. 𝗔𝗯𝗼𝗿𝘁 𝗠𝘂𝗹𝘁𝗶𝗽𝗮𝗿𝘁 𝗨𝗽𝗹𝗼𝗮𝗱 (𝗔𝗯𝗼𝗿𝘁𝗠𝘂𝗹𝘁𝗶𝗽𝗮𝗿𝘁𝗨𝗽𝗹𝗼𝗮𝗱): - Aborts and deletes the uploaded parts. - The object is no longer accessible. If you notice, calling 𝗖𝗼𝗺𝗽𝗹𝗲𝘁𝗲𝗠𝘂𝗹𝘁𝗶𝗽𝗮𝗿𝘁𝗨𝗽𝗹𝗼𝗮𝗱 or 𝗔𝗯𝗼𝗿𝘁𝗠𝘂𝗹𝘁𝗶𝗽𝗮𝗿𝘁𝗨𝗽𝗹𝗼𝗮𝗱 is a necessary step to conclude a Multipart Upload process, but it is easy to miss this when an upload process gets interrupted. This can cause dangling Multipart Uploads in your bucket and cost you $$$. But the good news is, it's easy to monitor and set bucket policies for such incomplete Multipart Uploads. Link in comments. Do check your S3 buckets for incomplete Multipart Uploads today, especially the ones holding large objects and the ones powering your data platform!

113

1 Comment

Customers have been asking for governance around data in motion. Now, Amazon Kinesis Data Streams supports data plane logging to AWS CloudTrail: https://lnkd.in/e5EEJE9x #governance #datainmotion #data #datagovernance #Kinesis

28

K2D allows extremely resource-constrained devices to be able to accept management operations via a stripped-down Kubernetes API, negating the need to run Kubernetes on the device itself. https://lnkd.in/e7mUtny7

2

Need help with container orchestration? Hire senior software engineers that know Kubernetes in 4-6 weeks🔥 You don't have to wait 6-18 months to start working on: ✅Microservices architecture ✅App scaling and high availability ✅Hybrid and multi cloud ✅Stateful applications ✅More... No need to wait for internal hiring. 📙Here's how: https://lnkd.in/gBQHKMyE #opensource #kubernetes #containers #docker #microservices

4

We are excited to announce the general availability of the Google Cloud Datastream append-only write mode that streamlines the process of replicating changes from your operational databases into BigQuery. This feature offers an efficient and cost-effective way to maintain historical records and track changes to operational data over time. #googlecloud #bigquery #datastream

23

📥 Import existing console-created resources into your #Terraform / #OpenTofu code. Read this post to learn how to manage existing cloud resources without recreating them using the 'import' command👇

4