Ward ☕️ Bekker

In March, Fullstaq could be found at KubeCon | CloudNativeCon Paris! Afterwards, Gerrit had an interview with Daniëlle in which he shared his insights on the event, the topics, and the potential future of Kubernetes and the cloud-native landscape. In this blog post, you can read all about these findings, tips on how to use AI, how to make developers comfortable with Kubernetes, and more! 🚀 Read it on our website: https://lnkd.in/enjWwq9G #cloudnative #cloudengineer #kubernetes #kubernetesandAI

17

🪵 Looking to get started with Loki and fulfill your glorious logging purpose? Start with this video! Jay Clifford and Nicole van der Hoeven discuss what Loki is, how to ingest logs with Loki, how to deploy Loki, and how to visualize your logs with Grafana.

41

3 Comments

New version of #Helm for ONLYOFFICE DocSpace is available. The latest version of Helm, the package manager for Kubernetes, is already here! It automates the #deployment, #management, and scaling of ONLYOFFICE DocSpace into Kubernetes or #OpenShift clusters. New Features: - Resource Annotations: Added the ability to set up annotations for all deployed resources. - Pod Annotations: Added the ability to set up specific podAnnotations for each service or define them globally. Discover more on GitHub at https://lnkd.in/dr5NBA9P Learn more about this #integration: https://lnkd.in/eQrUxb3y #software #solution #creativity #app #service #productivity #collaboration #platform #system

15

🚨 What's the state of Kubernetes, 10 years into it? During #KubeCon, Sander Almekinders sat down with Shaun O'Meara from Mirantis to talk about what's happening in the world of #kubernetes. It's an interesting discussion about maturity, challenges and - of course - the impact AI has and will have on #cloudnative development. You can find the link to the episode in the first comment below 👇 Martha de Monclin

5

1 Comment

DuckDB Labs has added first-party support for #DeltaLake in DuckDB using the new delta-kernel-rs project. In this blog post, get a short overview of Delta Lake, Delta Kernel and the new DuckDB Delta extension. 🦆🦀 Learn more: https://lnkd.in/emZ6KXJn #opensource #oss #lfaidata #duckdb

103

2 Comments

How OpenTelemetry tracing visualization in Coroot is different from on in Jaeger and Grafana https://lnkd.in/e6SYa-aF #coroot #jaeger #grafana #otel #opensource

10

In this third, extensively illustrated post of his windowing blog series, Bill Bejeck demonstrates sliding windows in Kafka Streams, and their logical equivalent in #FlinkSQL, OVER aggregations. Learn about use cases, like running average calculations, and more, here ➡️ https://cnfl.io/3W7N7qS

40

Introducing new Self-Service features, Topics and Topic Policies. Self-service is key to scaling Kafka in your organization, fostering collaboration and eliminating operational bottlenecks. Application teams can now fully manage their Topic lifecycle with an infrastructure as code approach 💻 While Platform teams keep control with Topic Policies - restricting misconfigurations and enforcing best practices 🔐 See what else is new in Conduktor. Link in the comments. #kafka #conduktor #productupdate

16

1 Comment

🚀 Integrating Dagger and GitHub Actions opens up a world of possibilities. Check out how a few cool tricks can automate comments on pull requests, and more! https://ow.ly/vTar50RNHUH

10

Squeezing JuiceFS with ClickHouse (Part 1): Setting Things Up in Kubernetes - Altinity | Run open source ClickHouse® better https://lnkd.in/eUUaVe5t #clickhouse #kubernetes

8

We built mirrord because we believe the lowest-hanging fruit in accelerating cloud development is reducing feedback time. In his article "Why Fast Feedback Loops Matter When Working with Kubernetes," Piotr Zaniewski discusses this in-depth and demonstrates exactly how you can use mirrord to tighten your feedback loops. Give it a read here: https://lnkd.in/dNR2qG24 #mirrord #kubernetes ‍‍‍‍‍‍‍‍

6

How does PerfectScale navigate around #kubernetes weaknesses?💡 Eli Berger explains how they buff up their system to provide a better container system for their clients #k8s #containers

"To ingest the incremental data from Kafka to S3, we considered three excellent data lake and ingestion solutions: Apache Hudi, Apache Iceberg, and Delta Lake. In the end we chose Hudi for its excellent performance with our update-heavy workload and its open-source nature & native integration with Debezium CDC messages." Excellent blog by Notion's data platform team on how they built their data lake (house) to meet the surge in 10x data growth due to user & content growth to cater to AI, Search, and other product use cases. 🔗 Blog: https://lnkd.in/dEYxAZDQ #dataengineering #softwareengineering

61

1 Comment

🔐 Struggling to connect headless devices like smart TVs to your app? It's a pain when there's no built-in support for OAuth 2.0 Device Authorization Grant in AWS Cognito. We’ve got you covered! Our data engineer, Stijn Janssens, breaks it down in our latest blog article: "𝐃𝐞𝐦𝐲𝐬𝐭𝐢𝐟𝐲𝐢𝐧𝐠 𝐃𝐞𝐯𝐢𝐜𝐞 𝐅𝐥𝐨𝐰. 𝐈𝐦𝐩𝐥𝐞𝐦𝐞𝐧𝐭𝐢𝐧𝐠 𝐎𝐀𝐮𝐭𝐡 2.0 𝐃𝐞𝐯𝐢𝐜𝐞 𝐀𝐮𝐭𝐡𝐨𝐫𝐢𝐳𝐚𝐭𝐢𝐨𝐧 𝐆𝐫𝐚𝐧𝐭 𝐰𝐢𝐭𝐡 𝐀𝐖𝐒 𝐂𝐨𝐠𝐧𝐢𝐭𝐨 𝐚𝐧𝐝 𝐅𝐚𝐬𝐭𝐀𝐏𝐈". Learn: 🔍 What Device Authorization Grant is 🔍 How to implement it using AWS Cognito and FastAPI 🔍 Real-world examples and practical steps Don't miss out! Click below to read the full article and streamline your device authentication process. 🚀 Read the Full Blog Here: https://hubs.li/Q02FPcm90 #DataEngineering #OAuth2 #AWS #FastAPI #TechBlog #HeadlessDevices #IoT #Dataminded

23

Do you know that Incomplete Multipart Uploads in S3 can also cost you money if you're not careful? There is a recent article by Maciej Poćwierz that talks about how AWS charges you for unauthorized requests to S3 buckets and how anyone can ramp up your AWS bill if they know your bucket name! Another somewhat similar but lesser-known problem is with S3 Incomplete Multipart Uploads which can cause an uptick in your AWS bill. S3 Multipart Upload is a feature that lets users upload large files to AWS S3 in smaller parts. Once all the parts are uploaded, S3 reassembles them into the original file. It helps with faster uploads and recovery in case of errors. The S3 Multipart Upload process involves the following steps 𝗜𝗻𝗶𝘁𝗶𝗮𝘁𝗲 𝗠𝘂𝗹𝘁𝗶𝗽𝗮𝗿𝘁 𝗨𝗽𝗹𝗼𝗮𝗱 (𝗖𝗿𝗲𝗮𝘁𝗲𝗠𝘂𝗹𝘁𝗶𝗽𝗮𝗿𝘁𝗨𝗽𝗹𝗼𝗮𝗱): - Starts the multipart upload process for a specific object in an S3 bucket. - Returns an upload ID used for subsequent API calls related to the upload. 𝗨𝗽𝗹𝗼𝗮𝗱 𝗣𝗮𝗿𝘁 (𝗨𝗽𝗹𝗼𝗮𝗱𝗣𝗮𝗿𝘁): - Uploads a specific part of the large object to S3. - Requires the upload ID obtained from CreateMultipartUpload. - Responds with an Entity Tag (ETag) for successful uploads. - Parts can be uploaded in parallel. 𝗖𝗼𝗺𝗽𝗹𝗲𝘁𝗲 𝗠𝘂𝗹𝘁𝗶𝗽𝗮𝗿𝘁 𝗨𝗽𝗹𝗼𝗮𝗱 (𝗖𝗼𝗺𝗽𝗹𝗲𝘁𝗲𝗠𝘂𝗹𝘁𝗶𝗽𝗮𝗿𝘁𝗨𝗽𝗹𝗼𝗮𝗱): - Assembles the uploaded parts into a complete object in S3. - Requires the upload ID and a list containing part number and ETag for each uploaded part. - Upon successful completion, the object becomes accessible in the S3 bucket. 𝗔𝗯𝗼𝗿𝘁 𝗠𝘂𝗹𝘁𝗶𝗽𝗮𝗿𝘁 𝗨𝗽𝗹𝗼𝗮𝗱 (𝗔𝗯𝗼𝗿𝘁𝗠𝘂𝗹𝘁𝗶𝗽𝗮𝗿𝘁𝗨𝗽𝗹𝗼𝗮𝗱): - Aborts and deletes the uploaded parts. - The object is no longer accessible. If you notice, calling 𝗖𝗼𝗺𝗽𝗹𝗲𝘁𝗲𝗠𝘂𝗹𝘁𝗶𝗽𝗮𝗿𝘁𝗨𝗽𝗹𝗼𝗮𝗱 or 𝗔𝗯𝗼𝗿𝘁𝗠𝘂𝗹𝘁𝗶𝗽𝗮𝗿𝘁𝗨𝗽𝗹𝗼𝗮𝗱 is a necessary step to conclude a Multipart Upload process, but it is easy to miss this when an upload process gets interrupted. This can cause dangling Multipart Uploads in your bucket and cost you $$$. But the good news is, it's easy to monitor and set bucket policies for such incomplete Multipart Uploads. Link in comments. Do check your S3 buckets for incomplete Multipart Uploads today, especially the ones holding large objects and the ones powering your data platform!

113

1 Comment

Tales tell of Prometheus, who stole fire and gifted it to humanity, aiding their technological and civilizational development. Today, software named after the legend helps gather and reveal insightful metrics. 🔥 At Tembo, we leverage Prometheus to gather metrics data from our systems. Follow this link to read how! Post: https://lnkd.in/gc6svzVZ 🩺 If you'd like to collect metrics from your own database, check out the following documentation. Docs: https://lnkd.in/ggTMJfhB 🟢 Try bolstering your metrics game on Tembo Cloud today! https://lnkd.in/gDQjj8ur #prometheus #metrics #monitoring

13

GitLab 16.11 feature spotlight ✨ Our new DAST analyzer performance updates enable teams to snip navigation paths to improve crawler performance, which reduced scan time by 20% according to our benchmark test. Learn more ⬇️ https://bit.ly/3wfUliA

61