teleren/devto huggingface dataset:
Amazon Kinesis data analytics
Tags: aws
Published: 2022-11-24 21:14:16

**Core of stream processing pipeline :**

- _Source_: Any device or software program that generates real-time data quickly qualifies as a source.

- _Stream Ingestion_: Data can be gathered and ingested in real time from tens of thousands of data sources. In this point, tools like Kafka can be useful.

- _Stream Storage_: For a predetermined amount of time, data is kept in the order it was received. Data can be replayed endlessly during this time, and order is important at this stage.

- _Stream processing_: Records are read in the sequence in which they are produced, enabling streaming ETL or real-time data analytics. You have data that is kept in stream storage, and you now want to process it so that you can understand it. This is point KDA is very helpful.

- _ Destination_: At this point, process data needs to be sent somewhere. This stage uses a data lake or data warehouse. It makes use of third-party applications or tools like S3.

**What are the use cases?**

This is the simplest place to start. The data you want to use has been aggregated, which reduces the amount of storage needed overall. Other alternatives include stateful event processing (currently underutilized but helpful in detecting fraud) and analytics apps (it help in making sense of data real time data coming from application).

**Amazon Kinesis Data analytics(KDA)**

What is stateful stream processing? IoT devices transmit data every minute in Fahrenheit; thus, we must process the data in a way that converts it to Celsius. Since we can use the lambda function, there is no need to keep the data while processing. The simplest technique to stream stateful computation is in this manner. The Apache Flink and Apache Beam prebuilt libraries can be useful and aid in applying a variety of operators. From a broad standpoint, flink would be useful in preserving the application state where you are reading and where you are writing. In a streaming situation, maintaining data integrity is simpler.
**Why Apache flink:**

We already discussed that it support diverse use cases in event driven application.
 
1. Expressive API: Because of its layered API strategy, including the use of wrappers around tables and SQL API, developers choose Apache Flink.

2. Process guarantee: consistency. No of nodes that processing the streaming data is exactly one processed. 

3. Scale out architecture: Adapt to desired throughput.

4. Community: Vibrant open source community.
 

Thanks to Deepthi Mohan for sharing her perspective and @aws-builders.
Cleanup large binary logs in MySQL
Tags: mysql
Published: 2022-11-24 19:32:49

---
title: Cleanup large binary logs in MySQL
published: true
description: Cleanup large binary logs in MySQL
tags: mysql
# cover_image: https://direct_url_to_image.jpg
# Use a ratio of 100:42 for best results.
# published_at: 2022-11-24 19:16 +0000
---

I had an issue where my drive was almost occupied by mysql log files (almost 400G). I am not sure about the cause of the issue but I needed a way to remove those files fast. This was in my local dev machine so I decided to remove those files completely. 

Here's a few commands to help you purge those files.

To purge logs created until a specific date: 
`mysql> PURGE BINARY LOGS BEFORE '2022-11-25 00:00:00';`

To expire logs after certain time:
`mysql> SET GLOBAL binlog_expire_logs_seconds=86400;`

Additionally, set `binlog_expire_logs_seconds` in a config file to persist it between service restarts.

References: 
1. [How to Solve Increasing Size of MySQL Binlog Files Problem?](https://askubuntu.com/questions/1322041/how-to-solve-increasing-size-of-mysql-binlog-files-problem)
2. [binlog_expire_logs_seconds docs](https://mariadb.com/docs/ent/ref/mdb/system-variables/binlog_expire_logs_seconds/)
The Transitional Web w/ Chris Ferdinandi
Tags: podcast, webdev
Published: 2022-11-24 20:41:47

{% spotify spotify:episode:4Lx8w1sCaqftg8TOTEBjeF %}

## What is HTML All The Things

HTML All The Things is a [web development podcast](https://podcast.htmlallthethings.com/) and [discord community](https://discord.com/invite/jweMCx9) which was started by Matt and Mike, developers based in Ontario, Canada. 

The podcast speaks to web development topics as well as running a small business, self-employment and time management. You can join them for both their successes and their struggles as they try to manage expanding their Web Development business without stretching themselves too thin.

## What's This One About?

This week we sat down with Chris Ferdinandi to discuss why he thinks the web is in a state of transition, moving away from bloated frameworks and other tooling, towards the use of more "vanilla" or "native" platform features. This less bloated web is where Chris believes we are already transitioning towards, with the hopes that it makes websites and web apps more efficient.


## Show Notes

* In your blog post you mention “the web is in a state of transition”, can you expand on that? - 00:03:30
* What is the lean web vs “the Bloated Web”? - 00:13:59
* Large frameworks like React and Vue are still being heavily used in the industry, why do you think that is set to change? What will we be using instead? - 00:34:00
* Do you think these ‘transitional tools’ will be around forever? - 00:41:56
* What would the ideal ‘web platform’ look like to you? - 00:50:50

## Links

* [Listener Link | For HTML All The Things listeners!](https://gomakethings.com/html-all-the-things/)
* [The Transitional Web | Blog Post](https://gomakethings.com/the-transitional-web/)
* [Go Make Things | Chris' Website](https://gomakethings.com/)


## Thank you!

If you're enjoying the podcast consider giving us a review on [Apple Podcasts](https://podcasts.apple.com/us/podcast/html-all-things-web-development-web-design-small-business/id1412209136) or checking out our Patreon to get a shoutout on the podcast. 

**[Support us on Patreon](https://www.patreon.com/htmlallthethings)**


You can find us on all the podcast platforms out there as well as

[Instagram (@htmlallthethings)](https://www.instagram.com/htmlallthethings/)
[Twitter (@htmleverything)](https://twitter.com/htmleverything)
[TikTok (Html All The Things)](https://www.tiktok.com/@htmlallthethings)
Building an RTS DevLog
Tags: gamedev, indie
Published: 2022-11-24 20:41:04

Aaaaaargh! Path finding is super hard to code, it's a trade off between hand holding all your units and letting them go rogue. Not to mention CPU and frame rate slowdown if badly implemented. 

 In this quick video I will cover that and talk a bit more about the game i'm working on.

https://youtu.be/5RxTEmYb_fM
This Portfolio took me one year to build
Tags: story, portfolio, laravel
Published: 2022-11-24 20:39:22

It can be really impressive to build something in one year but this is not what it is. This website took me one year to build because i didnt have the right tools and enough knowledge to make it work.I needed something perfect and simple for my portfolio.

Here is the [website](https://ngkader.com/)

![Screenshot of website](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/c4tuyo5lemur0camx84p.gif)

## The Stack
I was going to build my portfolio in Angular since i got some knowledge in it but after i did some manupaltion with a lot of trouble to manipulate the Dom (for Dark mode). I remembered  the KISS (Keep It Simple Stupid) principle and turned back to look around for other options.
It was at that time when i ran into Laravel yeah the one that almost every web developer heard about. I dig into it and it was awesome. I used blade template engine for the front end and installed a package Laravel Voyager which is an awesome admin panel to generate CRUD with BREAD (Browse,Read,Add,Delete) view that help me a lot with implementing Blog feature and backend stuff in general.
## The Features
Dark Mode 
Blog Feature
Project Feature
Internalization
## The Next steps
Add Vue components for some stuff 
Include Some Svg animations and a lot of it
Multilanguage with french as my native language and english as foreign (i did it 3 months after release thanks to one of freelancing project that i had done)  
I would like to have some insights about it what would you have done different.
Django Soft Design - Free PyPi Library
Tags: webdev, django, softdesign, opensource
Published: 2022-11-24 20:05:06

---
title: Django Soft Design - Free PyPi Library
published: true 
description: Modern template for Django coded on top of Soft Design, an open-source Boostrap 5 design from Creative-Tim - provided as a PyPi Library.
tags: webdev, django, softdesign, opensource
cover_image: https://dev-to-uploads.s3.amazonaws.com/uploads/articles/4b4d6dz0b5yrrkhdpm0u.jpg
canonical_url: 
---
Hello coders! 

This article presents an open-source theme for Django that can be used and installed as a library. [Django Soft UI Design](https://github.com/app-generator/django-theme-soft-design) Library allows integration of a modern **Bootstrap 5** Design into any **Django** project without much effort. Thanks for reading!

- 👉 [Django Soft UI Design](https://github.com/app-generator/django-theme-soft-design) - the library source code
- 👉 [Django Soft UI Design](https://django-soft-ui-free.appseed-srv1.com/) - LIVE Demo

![Django Soft Design Theme - Mobile View](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/4bb63s10hrqmx542xmrm.png)

---

Soft UI Design, the kit used to style the library, is crafted and released for free by [Creative-Tim](https://www.creative-tim.com/product/material-kit?AFFILIATE=128200).  Designed for those who like bold elements and beautiful websites, this open-source UI KIT is ready to help you create stunning websites and web apps.

{% embed https://www.youtube.com/watch?v=sNY_ZwChQNM %}

---

Soft UI Design System is built with over 70 frontend individual elements, like buttons, inputs, navbars, nav tabs, cards, or alerts, giving you the freedom of choosing and combining.

## VIDEO Transcript

- ✅ General information
- ✅ Access the LIVE Demo
- ✅ Access the playground project
- ✅ Visualize the configuration & routing
- ✅ Update the code (minor changes)

This Free Bootstrap 5 UK Kit is coming with prebuilt design blocks, so the development process is seamless, and switching from our pages to the real website is very easy to be done.

**Example Pages** - If you want to get inspiration or just show something directly to your clients, you can jump-start your development with our pre-built example pages. You will be able to quickly set up the basic structure for your web project. 

![Django Soft Design - Hero Section](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/wpm0gkoods52d83391ss.png)

---

> [Django Soft Design](https://github.com/app-generator/django-theme-soft-design) - Author Page  

![Django Soft Design - Blog Author Page.](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/wker31t6yt8flj649jz6.png)

---

> `Thanks for reading!` For more resources, please access:

- 🚀 Free [support](https://appseed.us/support/) provided by AppSeed (email & Discord)
- 👉 More [free apps](https://appseed.us/apps/open-source/) crafted in Flask, Django, and [React](https://appseed.us/apps/react/)
📢 Spring Boot 3.0 Goes GA 🚀
Tags: java, spring, news, springboot
Published: 2022-11-24 19:58:32

## 📢 Announce

Since today, the long awaited `Spring Boot 3` has been released today : 

{% twitter 1595849181800931328 %}

According to the [releaseNote](https://spring.io/blog/2022/11/24/spring-boot-3-0-goes-ga) : 

This release is the culmination of 12 months work and over [5700 commits](https://github.com/spring-projects/spring-boot/compare/e06b0d97f7c7881fac6008e8046ca511195d505e..14ba9b18dfa94155cc27ec964eae2d020fb3e305) by 151 different individuals. A massive thank you to everyone that has contributed, and to all the early adopters that have been providing vital feedback on the milestones.

This is the first major revision of Spring Boot since 2.0 was released 4.5 years ago. It’s also the first GA version of Spring Boot that provides support for [Spring Framework 6.0](https://spring.io/blog/2022/11/16/spring-framework-6-0-goes-ga) and GraalVM.

Highlights of the new release include:

- A Java 17 baseline
- [Support for generating native images with GraalVM](https://docs.spring.io/spring-boot/docs/3.0.0/reference/html/native-image.html#native-image), superseding the experimental Spring Native project
- Improved observability with Micrometer and Micrometer Tracing
- Support for Jakarta EE 10 with an EE 9 baseline

There’s far too many features to list them all here in detail, so head over to the [release notes](https://github.com/spring-projects/spring-boot/wiki/Spring-Boot-3.0-Release-Notes) page on our wiki to find out more.

## 📅 `endoflife.date`


[![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/vx59wgipkny4spgyz55e.png)
](https://github.com/endoflife-date/endoflife.date/pull/1904#issuecomment-1326884275)

{%embed https://github.com/endoflife-date/endoflife.date/pull/1904 %}
Colors with Tailwindcss
Tags: webdev, javascript, beginners, programming
Published: 2022-11-24 19:50:22

{% embed https://www.youtube.com/watch?v=KFtM4tuCTZs %}

Note: this is the first article of a long serie to teach the entire CSS library Tailwindcss.

## Introduction to Tailwindcss

Tailwind CSS is a utility-first CSS framework that helps you quickly and reliably create a completely custom, fully responsive website design. With Tailwind, you can use utility classes to control the layout, color, spacing and typography in your application — without needing to write any custom CSS or leaving your HTML.

Depending on what framework you are using, please refer to officials installation documentation to install it.

## How to use colors with Tailwindcss?

Tailwind means you have to write less custom CSS. Instead of building custom designs with cascading stylesheets, you style your elements by applying pre-existing classes directly in your HTML. By using utility classes in this way, you can build custom designs without writing CSS!

Also it helps you write clean and maintainable code by providing a flexible grid, fast typography, CSS variables, and more.

With Tailwind, you don’t have to go from blank slate to brand-ready in a single step. Instead, we include an expertly-crafted default palette out-of-the-box that’s ready for you to start with or customize.

```
<h1 class="text-blue-500 border border-blue-500 bg-slate-100">Blue title</h1>
```

In this example, we’ll have a blue title with blue borders and a background grey-light.

## Customization

Tailwind is a framework for building bespoke user interfaces, so it doesn’t come with a lot of built-in frameworks. As you’re building your application, you might wonder how to handle web typography or CSS transitions, or why you can’t just use .css styles instead of the built-in class system.

By default, Tailwind will look for a tailwind.config.js at the root of your project where you can define any customizations.

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/w7hd3pjj4cvwmvs7m9po.png)

However do not write directly colors into colors entries. Please place your news colors into extend.

If you are looking for a complete lesson on how to use colors with Tailwindcss, I highly recommend you to watch my video above.

See you for the next lesson,

Guillaume
Get a sound notification when your long-lasting script completes 🔔
Tags: cli, angular, productivity, commandline
Published: 2022-11-24 19:29:28

**Never again miss the moment when your long-lasting script in the background completes, thanks to sound notifications! While the script is running, you can safely switch to an other task 🧑‍💻 or take a break ☕️, being sure you won’t forget to check script’s results at the right time.**

### Speech-synthesized message

```bash
$ npm build && say „Build succeeded!” || say „Build failed!”
```

On MacOS you can use the command ‘say’ for the speech synthesis via the CLI. With the help of operators `&&` and `||` you can set a different message for a build success and failure.

_Note: there seem to exist equivalent commands to ‘say’ on other operating systems: [`ptts` on Windows](https://superuser.com/a/223914) and [`espeak` on Linux](https://superuser.com/a/93720) (which may differ a bit in syntax), however I didn’t try them._

### Feel less frustrated

In the past I used to either stare a few minutes at the terminal waiting for the script to complete (which drained my energy and focus capabilities) or switch to an other task, eventually forgetting about the running script in the background. It was the most frustrating, was when I figured out the build failed. And it failed very early, just after I switched to an other task.

### Be more productive 

Sound notifications really helped me to be more productive while fixing bugs which required from me re-building an app many times a day. Especially when it was a long-lasting production build of a big Angular SSR application. 

PS. For fun, you can customize the messages 😁, e.g.:

```bash
$ npm build && say „This is Sparta!” || say „Build failed. Get back, you lazybones!”
```
Passwordless Authentication with WebAuthn
Tags: auth, security
Published: 2022-11-24 19:21:16

Imagine being able to log in to websites without using any password, sounds cool right?

Passwords are hard to keep track of leading us to pick weak and easy ones which make us vulnerable to phishing attacks. WebAuthn solves this problem for us with passwordless authentication.

## What is WebAuthn?

WebAuthn—short for Web Authentication is part of the [FIDO2](https://fidoalliance.org/fido2/) framework, which is a set of technologies that enable passwordless authentication between servers, browsers, and authenticators.

WebAuthn let users authenticate with two types of authenticators:

One is with a **Roaming authenticator** a physical device like a Yubikey which can be used on multiple devices. The second method is with **Platform authenticators** attached to a device for example MacBook’s TouchBar, and Android’s fingerprint recognition.

## How WebAuthn Works?

It builds a trusted relationship between the device and the browser by creating public/private key pairs so they can communicate with each other and authenticate the user. This way, as a user, you don't need to have passwords for every site you visit, just a strong authenticator that works with WebAuthn.

The public/private key is different for each website, so one website cannot determine from the authenticator what other websites you have used it for.

## The Problem

No website supports WebAuthn...Wait!? What!?

The thing is all major web applications support WebAuthn as a second-factor authentication so it's not entirely passwordless after all.

The problem behind this is inconsistency in user experience between different browsers. Every website has different ways to set up passwordless authentication which makes it confusing and hard to understand for users.

We can hope for complete passwordless authentication in future with WebAuthn as it offers user-friendly authentication.


### Read more about WebAuthn

### [webauthn.me](webauthn.me)

### [webauthn.guide](webauthn.guide)
Fix "Could not find maven()" error in expo
Tags: rnmapboxmaps, expo, reactnative
Published: 2022-11-24 19:16:19

---
title: Fix "Could not find maven()" error in expo
published: true
description: Fix "Could not find maven()" error in expo
tags: rnmapboxmaps, expo, reactnative
# cover_image: https://direct_url_to_image.jpg
# Use a ratio of 100:42 for best results.
# published_at: 2022-11-24 18:58 +0000
---

I didn't have any issues building a development version of the app using expo. While running `npx expo run:android` I encountered an issue that something like [this](https://stackoverflow.com/questions/51493871/could-not-find-method-maven): "Could not find maven() for arguments ....".

The issue seems to be related to `@rnmapbox/maps`. 
To resolve the issue make sure to add the following maven configs inside repositories in `android/build.gradle`.

```kotlin
repositories {

        maven {
            url 'https://maven.google.com/'
        }

        maven {
          url 'https://api.mapbox.com/downloads/v2/releases/maven'
          authentication { basic(BasicAuthentication) }
          credentials {
            username = 'mapbox'
            password = project.properties['MAPBOX_DOWNLOADS_TOKEN'] ?: ""
          }
        }
}
```

Versions: 
Managed, config plugins + expo-dev-client
```javascript
{
  // ...
  "expo": "~47.0.8",
  "react-native": "0.70.5",
  // ...
}
```

References: 
1. [Android Build Failure | Could not find method maven()](https://forums.expo.dev/t/android-build-failure-could-not-find-method-maven/67668)
2. [Could not find method maven()](https://stackoverflow.com/questions/51493871/could-not-find-method-maven)
3. [RN 0.66 Could not find com.mapbox.mapboxsdk:mapbox-android-accounts:0.7.0](https://github.com/rnmapbox/maps/issues/1572)
STAR method for interviews
Tags: programming, elon, webdev, productivity
Published: 2022-11-24 19:05:42

If you are a follower of Elon Musk 🎓, you must have knowledge of how he hires new engineers. If you don't know, here is how.

[Elon said in an interview](https://www.youtube.com/watch?v=EoBA_W4Yj7o) he asks them "Tell me what is the most difficult thing you have worked on, and tell me how you solved it". Elon claims the people who actually worked on an issue will know the little details of how a problem was solved.

I would love to show you how this applies to my personal life. Recently, I was having an interview with an organisation (a start-up). The C.E.O was the interviewer -- imagine the stress about the need to impress him 🥶.

He asked me this same question, "Tell me what is the most difficult thing you have worked on, and tell me how you solved it". -- He doesn't know I know Jiu-Jitsu 😂. Luckily, the day before I had learnt of the **STAR** method. What is the STAR method ?, you may ask. 

**S** - Situation
**T** - Task
**A** - Action
**R** - Result

Here is how I answered, I told him: 

**(Situation)** - I was working on a side-project and 
**(Task)** - I needed to write unit tests in RTK query and I did not know how.
**(Action)** - I googled How to, and asked questions on stackoverflow.
**(Result)** - When I had learnt how to write unit tests in RTK query, I wrote [an article](https://dev.to/ifeanyichima/-testing-components-with-a-request-for-rtk-query-using-msw-and-react-testing-library-5a8n) to teach others what I have learnt and over 3,000 people have read that article. 

##Thank you, please follow me


<a href="https://www.buymeacoffee.com/ifeanyichima" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/default-orange.png" alt="Buy Me A Coffee" height="41" width="174"></a>


<span> 
[![HTML](https://img.shields.io/badge/LinkedIn-0077B5?style=for-the-badge&logo=linkedin&logoColor=white)](https://linkedin.com/ifeanyi-thankgod-chima)&nbsp;[![GitHub](https://img.shields.io/badge/GitHub-100000?style=for-the-badge&logo=github&logoColor=white)](https://github.com/masterifeanyi)
</span>