teleren/devto huggingface dataset:
📍 OPT-NC agencies on Kaggle
Tags: datascience, opendata, python, showdev
Published: 2024-02-21 20:00:48

## ❔ About

OPT-NC has [many agencies in New-Caledonia](https://www.opt.nc/service/l-opt-pres-de-chez-moi-trouver-une-agence), but getting `csv` files was not as easy as that, and if you wanted to use data to build datascience, **you had to achieve manual tasks.**

**👉 The purpose of this post is to show how we recently upgraded the [Developer experience](https://github.blog/2023-06-08-developer-experience-what-is-it-and-why-should-you-care/)... and the opportunities it does open.**

## 🎯 What you'll learn

You'll learn:

- **🛍️ The various datasources** we used to build a consistent & up-to-date dataset
- **🎁 Available dataformats** (`csv`, `duckdb`)
- **🎀 How to use** the dataset with a dedicated Notebook

## 🍿 Demo

{% youtube Y5PWxaxz1_E %}

## 📑 Related resources

1. [⚙️ Notebook builder](https://www.kaggle.com/code/optnouvellecaldonie/open-data-agences-opt-nc) (where the data is prepared and aggregated)
2. [🏤 Agences 📍 Dataset](https://www.kaggle.com/datasets/optnouvellecaldonie/agences-new)
3. [👨‍🎓 Agences OPT-NC for dummies](https://www.kaggle.com/code/optnouvellecaldonie/agences-opt-nc-for-dummies)

## 🤯 Opened perspectives

Delivering data on Kagglle make it possible to play with them with free GPU and...

Amazing Open Source AI models like `Mixtral` (see [Kaggle model card](https://www.kaggle.com/models/mistral-ai/mixtral))...

and more recently `google/gemma` (see [Kaggle model card](https://www.kaggle.com/models/google/gemma)):

{% twitter 1760289388204900633 %}

... or many other open source LLM models, see :

{% embed https://dev.to/adriens/local-open-source-ai-a-kind-ollama-llamaindex-intro-1nnc %}

or simply use OpenAI from your notebook and the AI do the job for you so yo can focus on your storytelling:

{% embed https://dev.to/adriens/put-magic-in-your-notebook-w-jupyter-ai-3co4 %}
TextMine - AI powered knowledge base for business critical documents
Tags: b2b, ai, saas
Published: 2024-02-20 03:25:07

TextMine is an E2E AI-powered knowledge base for your business critical documents, including invoices, payslips, tender documents, compliance reports, and even contracts. Our platform consolidates everything into a single operational layer to enable proactive decision-making. We provide increased data transparency whilst allowing document creation to be more scalable and uniform. We’ve helped organizations save money and time while reducing their risk profile and increasing compliance.

[https://textmine.com](https://textmine.com)
Free newsletter for secure development leaders <3
Tags: security, leadership, news, softwareengineering
Published: 2024-02-22 23:06:10

The latest edition of Secure Development Leaders is out now and shares three essential ingredients for building security culture in your development team.
Highlights:
* The importance of education (and why that's not about technology but motivation)
* Why education without empowerment is bad for your security
* The role of accountability (and acknowledgment).

It also includes top things you may have missed in #appsec this week.

[https://www.secdevleaders.com/p/three-essential-ingredients-secure-development-culture]

If you find this useful, subscribe! It's free [https://www.secdevleaders.com]
German veteran Cross returns to national team for Euro 2024
Published: 2024-02-23 12:08:52

The German national soccer team has called back "Veteran midfielder" Tony Cross 34, Real Madrid, who announced his retirement from the national team in 2021 in preparation for the 2024 European Football Championship Euro 2024 in his country in June.

"I decided to play for the German national team again from March. Why? I was asked by the national team coach," Kroos wrote on his Instagram account. "I am confident that with the national team, we will be able to achieve more than most people believe."

Cross, who first joined the German national team in 2010, is a veteran midfielder who played 106 A matches 17 goals.

With a wide field of view and outstanding pass skills, as well as creative play and outstanding set-piece ability, he played an active role as the "Central Commander" of the German national team, and helped Germany win the 2014 World Cup in Brazil.

Kroos, nicknamed "the football professor," announced his retirement from the national team in June 2021 after Germany were eliminated in the Euro 2020 round of 16 after losing 0-2 to England.

Since then, Cross has shown the dignity of a veteran by continuing his rusty skills at his team, Real Madrid.

In the meantime, Julian Nagelsmann, who leads the German national team, asked Cross to return ahead of the warm-up matches against France and the Netherlands scheduled for March, and Cross accepted this and chose to return to the national team for the first time in three years.

German soccer, which once showed off the world's top performance, has been mocked as a "Rusty Tank Corps" after a series of humiliations, including the elimination of the group stage of the 2018 World Cup in Russia, the elimination of the Euro 2020 round of 16, and the elimination of the 2023 World Cup in Qatar.

In the meantime, Germany, which has fallen to 16th place in the FIFA rankings, is the host country of Euro 2024, which will open in June, and has pushed for Cross to return to the national team, aiming to recover his pride. [토토사이트](https://www.betmantoto.org)
PYTHON - DAY 1.1 - my DOODLE
Published: 2024-02-25 18:56:39

### Write a program to choose a CATEGORY from the LIST and get the value for the same.

**_https://api.chucknorris.io/_**
**_https://api.chucknorris.io/jokes/categories_**

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/xs97k1wktex7a97gpqh6.png)

**_https://api.chucknorris.io/jokes/random?category=animal_**

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/6pxgy5brye51qdtaos5d.png)

> **_Code : cat sample.py_**

```
import requests
get_data = requests.get("https://api.chucknorris.io/jokes/categories")
print(get_data)
output = get_data.json()
print("List of the categories " , output)
get_input = input("Choose any one : ")
mydata = requests.get(f"https://api.chucknorris.io/jokes/random?category={get_input}")
#print(mydata)
myjson = mydata.json()
myjson1 = myjson["value"]
print(myjson1)

```

> **_Output : sample.py_**


`<Response [200]>
List of the categories  ['animal', 'career', 'celebrity', 'dev', 'explicit', 'fashion', 'food', 'history', 'money', 'movie', 'music', 'political', 'religion', 'science', 'sport', 'travel']
Choose any one : dev
Chuck Norris's log statements are always at the FATAL level.`


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/xxb90o7katg24kk03elx.png)
CDN's: What are they and how they work and why do we need them?
Published: 2024-02-26 12:44:30

CDN stands for **Content Delivery Network**. 

This thing is used, when we create objects in **object store**, that files will obviously exists somewhere in world. So when we upload files to AWS or any cloud provider that file exists somewhere in world. Somewhere in any server for ex: server in USA.

Now suppose, suddenly lot of people wants to access this file, from all over the world. 

Now how this will work is, all requests from all this people, from all over the world, will go to that single server in USA through very long wires and bunch of router hopes. The request will reach to the server and responses will be send back. This is very big file, for ex, 1 GB.

Wouldn't it be nice, if lot of people asking this file from India, what if this request goes to server which is somewhere present in India first, and everyone in India and then from this server, users who asked for file gets their response.

That is what CDN's let us do. It's name itself tells that its job is to deliver content.

CDN says, there are many object stores in world, let that be the source of your truth, but as people ask for any particular file, don't distribute it directly from S3 URL, use my CDN URL and just tell me what's the source is. 

So whenever we create CDN we just have to tell it what is the source, where that file is actually stored. So whenever anyone asks for a file to CDN it goes to source, later CDN cached that file on to the server present in India. So whenever anyone wants that file from India, it gets deliver to them easily. Now every request will not go to server in USA, because we have cached it, somewhere on server present in India.

Request from users in India goes to server present in somewhere [closest] present in India, which then asks source of truth, the place / server where it is originally stored, gets it back to server in India, and then caches it. So now that file not only present in server in USA but also in India. And now whoever wants it, they get it from server in India.

Objects / files / data is not cached for infinity, they are cached for certain period of time and after that time is over, the cache gets clear.

The main thing here to understand is how CDN's actually works. Content Delivery Networks make it very easy to deliver content. The thing that is so hard and expensive, if some file present only at one place in the world, and people / users from all continents starts to ask for it, CDN's creates what we called servers but they are technically are called as POP's. POP's stands for Point of Presence. 

Object stores, store or files at one place, CDN's have servers all over the world, which are technically called as POP's. 
This is very useful in case of very heavy applications, who not just store bunch of data, this are serving actual real world assets. Like mp4, jpeg files. 

So we not just need object store, we also need CDN's. Object stores are use for storage and CDN's are use for Distribution. And we have to pay for both of services if we are using AWS. And usually distribution cost is higher.
#cdn
The Amreen Infotech: Best Digital Marketing Agency To Grow Business
Published: 2024-02-26 07:04:11

The Amreen Infotech emerges as the [Best Digital Marketing Agency To Grow Business,](https://www.theamreeninfotech.com/) specializing in a diverse array of services including graphic design, SEO, PPC, web development, and more. With a focus on delivering exceptional results, Their expert team crafts tailored strategies to elevate your online presence and drive business growth. Whether it's creating visually stunning graphics, optimizing your website for search engines, or managing effective PPC campaigns. Trust The Amreen Infotech to be your strategic partner in navigating the digital landscape, propelling your brand to new heights of success. To learn more about the company, please click on this link: 
https://theamreeninfotechblog.wordpress.com/
HOW TO USE EOS HYPERION HISTORY NODE
Published: 2024-02-26 21:13:02

{% embed https://docs.google.com/document/d/e/2PACX-1vQwi6xYSFoVMWJHYZe5K5JhZajgC3xVyRDYli41Zz0LO1KIrIuA7rrPyjGBQEI16YtJ37Ur7AEO6iCW/pub %}
Cloudinary to s3 bucket db changes
Tags: webdev, javascript, node, mongodb
Published: 2024-02-27 06:02:14

If you have a database collection that has url field , containing cloudinary or any cloud based platform links and you want to shift/ migrate the urls specifically to s3 bucket then you can use this script.

```
     query = { $regex: /^https:\/\/res\.cloudinary\.com/i }
     const urls = await Audio.find(query).toArray(); 

        const audioList = [];

        // Iterate over each document and process one at a time
        for (const doc of urls) {
            const _id = doc._id;
            const url = doc.url;

                  const filename = path.join("L:/Check Audios", `${_id}.mp3`);

//Function to download and save audio locally 
            await downloadAndSaveAudio(url, filePath);

            // Upload the audio file to S3
            const uploadParams = {
                Bucket: bucketName,
                Key: filename,
                Body: fs.createReadStream(filename),
                ContentType: 'audio/mp3'
            };
            const uploadResponse = await s3Client.send(new PutObjectCommand(uploadParams));

            // Generate S3 URL
            const s3Url = `https://${bucketName}.s3.${bucketRegion}.amazonaws.com/${filename}`;

            // Update the database with the S3 URL
            await Audio.updateOne({ _id: _id }, { $set: { url: s3Url } });

            // Push information to audioList
            audioList.push({ _id: _id, s3Url: s3Url });
        }
```
Regain Bladder Control: The Latest Treatments for Urinary Incontinence
Published: 2024-02-27 16:06:21

Do you find yourself constantly worrying about unexpected leaks or feeling embarrassed by your lack of bladder control? Urinary incontinence is a common condition that affects millions of people worldwide, and it can significantly impact your quality of life. The good news is that advancements in medical technology have led to innovative treatments that can help you regain control over your bladder and pelvic floor muscles.

**Understanding Urinary Incontinence and the Pelvic Floor
**Before we delve into the latest treatments, it’s important to understand the basics of [urinary incontinence](https://forlooks.com/emsella/) and its connection to the pelvic floor muscles. Urinary incontinence refers to the involuntary leakage of urine, often caused by weak or dysfunctional pelvic floor muscles. These muscles play a crucial role in maintaining bladder control, supporting the organs in the pelvic region, and preventing leakage. Factors such as pregnancy, childbirth, menopause, and aging can weaken these muscles, leading to incontinence issues.
AI and the future of web and mobile development
Published: 2024-02-28 01:09:53

AI boom is real this time, unlike many years ago.

As a web and mobile developer, I’d like to share my prediction for AI and the future development of web and mobile applications.

The LLM-based ChatGPT really changed the way people interact with machines these days. Before the ChatGPT, we use browser for the web, operating system for PCs, android or iOS for mobile devices. This is also the reason behind why do we need different technology to develop applications for different platforms. However, this paradigm might be change in the future as AI will be the only platform or operating system to become a unified interface. Developers Developers’role will also change. There will be no mobile developer or web developer in the future. This AI platform will be the SDK for all developers to work on. Websites and apps will be replaced with personalized applications developed on this SDK. Much like app store, but this time it is the GPT store or something similar. Need to open an online shopping mall? Just open command and type your needs and images and description, GPT will develop an app from scratch and add this to their GPT store.

The scary part of this story? We no longer need that many developers anymore. Everyone can be a developer with little knowledge of computer science or programming. The traditional role of software developer or programmer will not exist.

I can see this wave is coming. Maybe in 5~10 years it will become reality. AI is a double-edged sword. Use it wisely and don’t be the last person to know why your role is made redundant.
Alkaline water has a higher pH level | Health Center Network
Tags: alkalinewater, healthandwellness, waterpurifier, alkalinewaterionize
Published: 2024-02-28 06:58:17

Quench your thirst and rejuvenate your body with our [Alkaline Water Plant](https://www.healthcenternetwork.in/). Through an 8-stage purification process, our water ionizer optimizes pH levels, ensuring clean and refreshing hydration. Experience the benefits of alkaline water and elev
![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/7vrnmhptz2joqiraby2k.png)ate your well-being- indian citizen company.
Have You Explored the Power of Instant Host Notifications in Modern Visitor Systems?
Tags: vsitor, tracking, technology, software
Published: 2024-02-28 11:38:34


![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/iy4cgpqmm6e2oaxtxrx1.png)

In the rapidly evolving landscape of modern visitor systems, the power of instant host notifications stands out as a game-changer, revolutionizing the way organizations manage and enhance their visitor experiences. This advanced feature leverages cutting-edge technology to provide real-time alerts to hosts, ensuring seamless and secure visitor interactions.

Key Points:

Real-time Communication: Instant host notifications enable instantaneous communication between the **[visitor system](https://www.innomaint.com/solutions/visitor-management-system-software/?utm_source=seo_article)** and hosts. As soon as a visitor checks in, hosts receive immediate alerts through various channels such as mobile apps, emails, or SMS, allowing them to promptly welcome and assist their guests.


Enhanced Security: The rapid notification system contributes significantly to the overall security of a facility. In the event of unexpected or unauthorized visitors, hosts can take swift action, preventing potential security breaches. This proactive approach adds an extra layer of protection to sensitive environments.


Improved Efficiency: Traditional visitor management systems often relied on manual processes and paper logs. Instant host notifications streamline the check-in process, reducing wait times and enhancing overall efficiency. Hosts can prepare for the arrival of their guests, optimizing time and resources.


Customization and Flexibility: Modern visitor systems offer customizable notification settings, allowing hosts to tailor alerts based on their preferences and schedule. This flexibility ensures that hosts receive information in a manner that suits their workflow, improving overall user satisfaction.

Visitor Experience Enhancement: The seamless integration of instant host notifications contributes to an elevated visitor experience. Guests feel welcomed and attended to from the moment they arrive, fostering a positive impression of the organization.


Data Insights and Analytics: Beyond immediate notifications, these systems often provide analytics and insights into visitor patterns. Hosts can leverage this data to make informed decisions, enhancing the overall management and optimization of visitor interactions.

In conclusion, the exploration and implementation of instant host notifications in modern visitor systems represent a paradigm shift in how organizations approach visitor management, combining efficiency, security, and an enhanced visitor experience. As technology continues to advance, these features will undoubtedly play a pivotal role in shaping the future of secure and seamless visitor interactions.
What are you learning about this weekend? 🧠
Tags: learning, beginners, discuss
Published: 2024-03-09 12:30:00

Howdy! 🤠

Hope you're weekend is going well.

Whether you're sharpening your [JS](https://dev.to/t/javascript) skills, making PRs to [your OSS repo of choice](https://github.com/forem/forem) 😉, sprucing up your portfolio, or [writing a new post](https://dev.to/new) here on DEV, we'd like to hear about it.

Learn some, chill some. Repeat! 🤜💥🤛

![A goofy vaporware-style graphic of a character with an old school computer body/heat that is sitting on top of noodly limbs dances around. Ocassionally their screen reads "analyze this."](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/4zdv19bga8r4exp6gicj.gif)
Avoid These Pitfalls: A Programmer's Guide to Career Success
Tags: programming, beginners, career
Published: 2024-02-29 04:21:04

In the world of programming, success isn't just about writing great code; it's also about avoiding common pitfalls that can derail your career. Let's explore some key things programmers should avoid for a brighter professional future.

## Neglecting Soft Skills
While technical skills are important, don't overlook the value of soft skills like communication, teamwork, and problem-solving. Programmers who excel in these areas are better equipped to collaborate effectively with colleagues and deliver projects on time and within budget.

## Failing to Stay Updated
Technology evolves rapidly, and staying current with the latest trends and tools is essential for career growth. Failing to invest time in learning new technologies can lead to obsolescence and limit your opportunities in the ever-changing tech landscape.

## Ignoring Code Quality
Writing sloppy, poorly documented code may seem expedient in the short term, but it can lead to maintenance nightmares and decrease your value as a programmer. Always strive for clean, well-structured code that is easy to understand and maintain.

## Working in Isolation
Collaboration is key in today's interconnected world. Avoid the temptation to work in isolation; instead, actively seek feedback from peers, contribute to open-source projects, and participate in developer communities to expand your knowledge and network.

## Neglecting Self-Care
Long hours and tight deadlines are part of the job, but neglecting self-care can lead to burnout and negatively impact your performance. Make time for hobbies, exercise, and relaxation to maintain a healthy work-life balance and sustain your passion for programming.

#### Watch This Video Only If You Know Hindi and Can Bare Awful Audio and Unprofessional Description.
{% embed https://www.youtube.com/watch?v=8utVaB4MMwo %}

> By avoiding these common pitfalls, programmers can set themselves up for long-term success in their careers. Remember, it's not just about writing code—it's about navigating the challenges of the profession with skill and foresight.
AWS cross account access (switch role)
Tags: aws, iam, iamrole
Published: 2024-03-11 01:07:10

In this tutorial we will switch role delegated to access a resources in different AWS accounts. You share resources in one account with users in a different account. By setting up cross-account access in this way, you don't have to create individual IAM users in each account.

- Access AWS console
- Open Identity and Access Management (IAM)
- Click "Roles" on left side menu

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/wkx9s9zelfcih26ua4a3.png)

- Select the AWS account
- Since it is a cross account access, give the the Account ID to which you want to grant access to your resources

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/zap6mc5obvpylgkch8zy.png)

- Next is to give the permission policies, type the policy you want to attach in the search bar.

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/int3pwk41z4oe2o63ebe.png)

- Add the Role name, and an option description. Then create the role

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/bzpp0mtg9yk9vglftu7k.png)

- Finally role can be used in cross account by clicking on switch role in the console

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/l3nsft93avbqka3mismm.png)

- Role can be switched by inputting the Account ID, Role name.

![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/bergfz7butbr3dec2mgl.png)