skysight-inc/HackerNews huggingface dataset:
Show HN: Copy from URL – A tiny tool to bypass robots.txt for AI chatbot
Hello HN! I'd like to share a very small project I've built called "Copy from URL" (https://copyurl.io). It's a minimal tool designed to solve a common frustration when working with AI chatbots like ChatGPT or Claude.

The Problem:
Many of us need to copy website content for AI queries. However, popular sites often use robots.txt to block AI crawlers, resulting in errors when trying to use these sites with AI.
The Solution:
Copy from URL is a simple, no-frills web tool that lets you extract text content from any webpage, bypassing robots.txt restrictions. Here's all it does:

- You enter a URL
- Click "Go!"
- Get clean, copyable text content
- Use it in your AI interactions

Key Features:

- No registration
- Open-source (GitHub link in comments)
- Completely free
- Bare-bones functionality

Tech Stack:
Built with minimal dependencies using Next.js, React, and Tailwind CSS. Uses Cheerio for HTML parsing.
Privacy & Security:
We don't collect or store any data. Everything happens client-side.
This is a very small project born out of personal necessity. It's not feature-rich or complex, just a simple tool that does one thing. I thought others might find it useful too.
I'd love to hear your thoughts or suggestions, especially if you've encountered similar issues with AI interactions!
I'm Canadian and growing up, I remember many shampoo commercials having some connection to Australia (ex brands named Aussie Naturals). You must have really great hair!
> Our careers are defined by the highest moments of its biggest upside swings.

The author makes this logical attempt to "refute the paradigm of fitter, happier, more productive routines as the secret to success" but starts with this completely subjective premise which is kind of hidden in this word salad sentence.

"Success" by other definitions can be greatly enhanced by routine and regularity. If I define my career by the time I have available to myself while making enough money the a routine helps tremendously. I can focus and get things done so I can stop working. That's success!
Ask HN: What other languages exist for talking about electricity?
I've made a new language for electricity. I've found the existing language taught in textbooks a mess full of legacy stuff that often means the opposite of what is actually happening.

In my new lang, everything revolves around electrons.

For example, batteries have a surplus side and a deficit side, and current is the flow of electrons from the surplus side to the deficit side.

It's a work in progress, but I'm close to having a version to share.

Now I'd like to see what prior art exists.

I'm hoping someone has already done this, and I can just use their's and drop mine.

What is out there?
No More postman just use cURL and Vim
There are many alternatives available but the GP is saying Gatorade nonetheless dominates the market. They aren't doing anything anticompetitive to achieve that domination, consumers just prefer them over the many alternatives.

That's the argument anyway, I don't know how much of that is true.
Sound like the writer didn't like routines and created the logic backwards from there. There are many things in life that are low impact on their own, but have a cumulative effect. Yeah yoga in the morning isn't 10X... I guess the only option is to be a chump or go straight to max dosage of anabolic steroids.
I have been wondering the reason why online generative AI can serving so many requests. This really gives me an explanation.
Github codes: https://github.com/Amunzen/CopyFromURL

Any comment is welcome! Thanks.
Opinion.

Code to low code to no code.

A code can be converted to a low code. A low code can be migrates towards no code.

That's an ideal world scenario. These platforms and other platforms out there are heavily tightly coupled between front-end and backend hence making them unclean.

Why unclean? Migrating a code based builder(IDE) to a low code based builder (GUI with confoguration) to a no code based builder (DRAG AND DROP) ultimately towards design to code builders.

Unfortunately there isn't any.

Here is how I made my statements above.

An app is a giant state of rectangles of content with show or hide configuration. Each state is followed by an user interaction.

Now the problem is reduced to a UI.

How about building an UI that builds UI?

I have few things documented in past commits of my project called ui-editor.

I stopped working on it publicly due to time consumption of new commits. You can find the wiki or the read me in pat commits.

https://github.com/imvetri/ui-editor.

My opinion, those products don't scale or not maintainable in long run. Because those apps or the builders are code based. To have a clean solution! The builder should be a no code in first place.
One of the most interesting drives in my life was Chile from the island of Chiloe to the Tatio Geysers in the Atacama. Just so many different climate zones, and all in relatively close proximity.

Chiloe and Puerto Montt were damp, cold, and fog-shrouded in Summer (Jan-Feb), very similar to parts of the coastal pacific northwest.

The area to its north, centered around the German-influenced town of Valdivia, was California-like. Very temperate in Summer, and very green. Lots of pastures and rivers.

The region becomes progressively more "Mediterranean" as you move further north; one gradually sees fewer pastures and woodlands, more vineyards, olive trees, and fruit orchards. Santiago is on the far northern end of this Mediterranean zone. The great wine regions are generally to the south and west of that capital city.

A few hours north of Santiago and all is desert -- but it's a fairly live desert, with all sorts of succulent plants and many types of flower. Most of the road traffic in these parts comes from copper miners and their work trucks.

Continue north and you're in a dry, mostly empty, moonscape. Antofagasta and Calama are nice enough towns, though, and the interesting drive from the former to the latter takes just two hours but sees you rise from sea level to +2000m. It's such a gentle and relentless slope that you barely notice it. Nothing at all like driving in the Alps.

I broke something in my rental car when I continued to the geysers at +4000m, but it was worth it.
I felt like I would agree with this article more than I did.

I'm definitely one of those people who has fallen into the slump of do a bunch of the same things every day, rinse, and repeat, largely driven by the requests of others. I do despise it, but at the same time, I wish I worked some more routine into my day so I can make more progress on the things that matter to me. But largely I feel burnt out from the routine of others that is imposed upon me, and it causes an almost visceral reaction to adding more planned time to my day.

But I think where I really didn't connect was the framing. The "productivity" thing, as if my goal in life should be to maximize output. The author frames routine as a robotic state, but I'd argue productivity maximization is an even more robotic trait.

It's really okay to have some hours in your day where you both don't have a routine and don't "accomplish" anything.
> a grinder might work 100 hours/week versus a mere 30 hours for an oaf.

I suspect many oafs do a lot less effective work than that during a week.

Source: have been such an oaf after a period of burnout
There's no way that that amount of projected spend over the next 10 years doesn't result in a lot of new efficiencies in chip production costs and energy usage, particularly a move away from graphics cards to more purpose built chips and algorithms designed for purpose-built chips.
The only case I see is against "10x" and overachievement in general. My morning yoga routine keeps me in shape and healthy. It's very pedestrian, I don't try to improve much, but it works. Maybe people should learn to relax a little and think about what's really important.
AI does have some legitimate uses (i.e., Grammarly and GitHub Copilot). It’s just when people say they are going to replace a whole operating system with AI that they are full of shit lol
If you actually use this search parameter, it is indeed someone injecting some information to steal your search rankings for their own good. They can just arbitrarily generate this and add links to other sites, so Google will eventually index it. To prevent this abuse, you could return an HTTP error code when the search result is longer than X characters, includes braces, and so forth.

If you don't use any search parameter or they don't use the one you are using, I would recommend adding a [canonical meta tag](https://en.wikipedia.org/wiki/Canonical_link_element) which signals to Google that only a specific version of a site is the source of truth. For example, adding a canonical by removing the query string from the current URL, example.com/page?foo=bar and example.com/page would have set the canonical value to example.com/page. So even if people link to specific parts which includes an arbitrary query string, Google will only index the one you specify without the query string, and these links you mentioned will not do anything (except potentially showing up once or twice in your analytics software).
If you think that's petty, look at what Trump is calling for.

https://lite.cnn.com/2024/07/02/politics/trump-liz-cheney-mi...
Highly entertaining, keeps you surprised as you never know what's happening next, and full of images without being memes. Loved it.
But can clean energy rewrite War and Peace in the style of a Green Day song?
Streaming LLM Requests with Python
Why so complicated. Lying flat is just quiet quitting. 996 is all the overworking, crunch time shit. How can they possibly coexist in the same country....well, you see, a country consists of more than one person...
No excuse for not building one giant high speed multi-tracks train line from North to South then :)
For a little comparison, Ford delivered about 1 million[0] vehicles globally in 2024 Q1, about 508,000[1] in the U.S. EV sales are still a tiny blip (about 10,000.)

[0] https://fordauthority.com/2024/04/ford-motor-company-earning...

[1] https://fordauthority.com/2024/04/ford-motor-company-sales-n...
Is it? I mean he was discussing it with his vice president and members of his cabinet.

If a president discusses with his cabinet how to fight a war in a way that is possibly illegal (and then orders it), that is an official act, executing illegal actions, and is immune.

What is the difference between that and preventing the transfer of power to your political opponent?

Especially since now parts of your activity's are "official" and cannot be mentioned in court, and part of your activities are not official which are potentially prosecutable, see Barrett's arguments.

Got to love it when supreme court creates all these exiting new laws.
I created a similar in-browser version a while back with mozilla's pdf-js. The diff rendering is all run client side.

https://www.parepdf.com

The diff-pdf project was my inspiration but I wanted to create a version that was distributable to non-programmers.
I guess you could also spin up a OpenBSD server running SSH and use that as a jump host.
Then you adapt to the new reality. If you worry about changes making something impossible you can't start anything.
if you want to achieve some greater good, capitalism is not the ideal model to begin with. it creates a lot of wealth, but needs strong external forces to not only focus on profits or destroy everything in the process.
The real skill is storytelling. Or, frame setting if you want. It absolutely can lead to safety and empowerment, but it’s an incredibly difficult set of skills for most people to learn. Essentially, instead of expressing content into a conversation, you express context. Instead of “stop spending so much of our money”, you say “You know, I keep thinking about what it’ll be like for us together when we retire. I have this nightmare where we’re poor…”. Or, someone says “You’re just not listening!” And you respond with “Oh, if youre not feeling listened to, let me try to express back to you what I’m hearing you say. And after you feel heard, then I’ll respond.”

Frame setting is a tool of power. It’s probably the single greatest tool that exists for manipulating people. (Well, aside from offering people giant sums of money). It’s the tool of good therapists and psychopaths the world over. And I think the only way to build resilience against it is to learn the skill yourself.

(It also comes with a paired skill - which is to become consciously aware of the frame someone is speaking from, and being able to name and debate the frame itself.)

Robert Kegan has a developmental model that bunches people into one of 5 progressive stages of cognitive development. The 5th stage is (very loosely) characterised by this sort of thinking. They did a broad assessment of the population and found only about 5% of people assessed are in this stage.

The sad truth is that most people spend their whole lives subject to the frames that other people set for them. Speech from outside the frames you know is usually incomprehensible.
The crates that I have looked at work by installing their own minimal signal handler which then puts a message into a channel, or otherwise delivers the message that the signal was fired to your code in a safe way.

Of course, you are still trusting that the implementation is sound.
You can make it all some kind of json object and use plenty of tools to parse.

I think text is really awesome though. You can read it with any editor and there are a zillion easy to learn Linux tools like grep, cut, awk...etc for interactively creating a oneliner in a short amount of time that you can use to get what you want out of the text. I used to have a bunch of those when I was in charge of some applications on a Linux server. Text is very universal and I'm not just talking about log files.
by AVR you mean https://en.wikipedia.org/wiki/AVR_microcontrollers , right?
There's plenty of historical examples of how bad of an idea prosecuting former leaders is. When a country's leaders fear prosecution if they lose power, they have every incentive to cling to power as long as possible by any means necessary. Certainly there's a middle-ground that needs to be struck between the President they are above the law entirely and the President fearing prosecution by the next party in power regardless of how lawful they behaved. I worry that, in the U.S.'s current political climate without immunity, Presidents would be prosecuted by the other party as a matter of course.
macOS Sequoia Features Intel Macs Won't Support
this comment made my day.thnx
SAS war crimes inquiry obtains cache of new evidence, BBC reveals
> Between 2000 and 2018, the percentage of car crash deaths in the United States involving cannabis have doubled

I assume a higher percent of people have access to and are using cannabis during over same time period, lowering the scale of the effect
China-Nexus Threat Group 'Velvet Ant' Exploits Cisco Zero-Day
That doesn't read like science, it reads like an ideological statement. The current punishment for scientific fraud is non-existent and academia is full of it and ideologically driven pseudoscientific research.

Subsequent evidence debunked that "post-mortem", as another user posted.

We've seen, with evidence, China pressure research groups and Nature into calling the lab leak hypothesis a conspiracy theory. Like "fake news", "conspiracy theory" is now actively used by China as a way to shut down evidence.

From subpoenaed communications we even know that certain figures who publicly denounced the lab-leak theory as a conspiracy, privately believed the theory was likely.

https://www.wsj.com/articles/the-covid-lab-leak-deception-an...

Government covert operations are not the kind of phenomenon science can properly study because it's not reproducible and data is not open. It's the realm of investigative journalism and intelligence.
Flunk the office. Have fun outside work.
As sibling poster pointed out, the researchers themselves likely would prefer that their work be available to all, and that it is not will be by decree of someone other than themselves.

In that vein, I have never once failed (across at least several dozen attempts) to obtain a gratis copy of a paper by writing an author directly, even if I don't have access to the journal which published it. More often than not the researcher has been thrilled to have been contacted by a random person with interest in their work; I've had some interesting personal interactions and several times had follow-up questions answered. I highly recommend doing this.

Edit: you probably know this. I'm posting my experience for the benefit of others who may come across these comments. Most people in academia are nerds at heart, and very nice to anyone who shares their interests.
No, I do mean misogyny. Women are just as capable and willing as men to fight and defend. With modern weapons especially, there is no real difference between the fighting capacity of a woman and that of a man. And women are people in their own right, not things to be protected to perpetuate society.

Also, women are not children. Children deserve protection because they don't know any better, their minds are not fully equipped to understand what going to war means. Additionally, children make very poor soldiers, as their motor skills and reasoning skills and emotional control are just not developed enough to function as well as an adult, particularly in times of extreme stress such as war.

So again, children require and deserve protection from the rest of society. Women neither require it, nor deserve it, not any more than any other civilian.
McAfee sold it's Entrerprise division in 2021. Ever since they have primarily focused on scaring boomers into subscription plans. They used to have an on-prem EDR platform called McAfee EPO but I think that was replaced with some cloud hosted subscription garbage. I won't use cloud based security products. On-prem security should have an on-prem solution. Anyone who says otherwise gets their paycheck by hawking servitization or hosting data. The reasons for outsourcing are weak.

To your point about reverse shells, last time I tried about 2 years ago, meterpreter was still sneaking past almost everything. There are some tools on Github for detecting it, but it is very good at evading detection in general.
Here is an insane video showing how difficult it can be to dig pumped storage tunnels: https://youtu.be/6AV2NcyX7pk
In China, the addiction of apps like TikTok, Temu been driven to perfection
Interest in Music is Declining [video]
This is silly. You do the routine stuff so that when the "10x" opportunities come, you are fit to execute on them. It's like saying pro athletes shouldn't spend all that boring time in the gym - just score some points! Maybe the author is trying to point out that it's easy to think that the routine stuff is the ultimate point, which is fair, but I fear (young) people will read this and think (as I used to) that all they have to do is go with the flow and be naturally brilliant.
i accidentally used the new implicit constructors for aggregates in c++ the other day, and then my code didn't compile with the version of clang i have installed on my cellphone
Would anyone use a macOS native animation editor?
Berkshire East is working on a micro pumped storage facility. Interestingly enough they’re already net producers of electricity.

https://berkshireeast.com/the-resort/100-renewable-energy
CAR-Ts achieve spectacular remissions against autoimmune diseases
The Atacama Desert is exceptional, the absolutely best solar energy resource on the planet.
There's no "one size fits all" solution. Some folks work best when they highly structure their time, some folks with less or almost no structure. Experiment and find what works best for you.

Personally, I find it best to block out some time for things I want to get done and things I must get done. Those are my daily routines. :) Everything else, I fit in on the fly.
You often don't know which work was "10x" except in retrospect, so this advice is a little like recommending people only invest in the stocks that are going to go up.
I did something similar some time ago: Booting from an RPM repository on a Tumbleweed installation DVD.

My initial goal was to write a fuse filesystem for mounting RPM packages, but I wanted to see how far it goes. Turns out, pretty far indeed: https://github.com/Vogtinator/repomount/commit/c751c5aa56897...

The system boots to a working desktop and it appears like all packages available on the DVD are installed.
Mandatory shock absorbing helmet during training would be helpful I guess.

What other preventive measures could be employed?
I am much better at identifying 10x work when I'm in a good daily routine. YMMV.
One way or another, you will have a routine. We are creatures of habit. It can either work for you or against you.

This seems mostly a diatribe against chasing "productivity" in disguise, with anti-routine as the clickbait hook, bait-and-switch. Habits are powerful in part because they allow you to reduce overhead. If your auto-pilot routine is to doomscroll, why would this be less stressful than a yoga session?

> The question is how to create the most opportunities at achieving that, not how to execute perfect little habits.

Say, wouldn't it be nice if there was some tool we could leverage to do that?

Yoga and meditation isn't about advancing your career.
What’s wrong about it? I haven’t managed k8s much and don’t have enough experience to evaluate their claim.
We've kept chickens for about 13 or so years now.

For daily tasks, all you really need to do is collect the eggs. If you have a big enough feeder and water supply, you can just top those up once a week.

You do have to lock them up at night and release them in the morning, but that is covered by something like the devices here: https://chickenguard.co.uk/shop/

This is in the UK where the main predators are foxes.

I don't know why the author is chasing his chickens back to the pen. They normally want to go back to the coop to roost at night on their own.
Can anyone recommend a method to deduplicate pdfs? The hash is often different but the content and meta data is 99.99% the same.
Figma to temporarily disable ‘Make Design’ AI feature amid plagiarism concerns
Ant Design – the second most popular React UI framework
1) You are not the intended audience.

2) Much like a research paper, reports like this benefit from the standard page size. You will fit relevant information on the same page for the benefit of the narrative/reader. This is one of those areas where I believe its hard to make it work on a mobile device.

3) This is just the standard for reports.
Some medical articles we have to add “… in mice” to the title to get the true picture.

Here, they haven’t done it on mice yet, that’s the next step.

So this is promising but still a long way out.
Yeah, I was wondering about these two countries myself. Also it was very strange to see the Peru and Cuba correlation, those two dialects are nothing alike.
I read somewhere that their accuracy is on par with a coin flip, but that's also true for all analysis that is posted/voiced publicly.
Like the article asks, what is the 1 trillion dollar problem gen-AI solves? Sure there are use cases - but the point is that the potential value doesn't remotely line up with the investments being made.
Came for LibreOffice, saw that mentioned already.
> and I now work as a teacher with "10x personal satisfaction".

I don't know what country you're speaking from, but here in the US teaching seems to have an extremely low job satisfaction rate.
Anything good that integrates with vscode?
To each their own. I can't imagine doing UI development without HMR anymore. Makes it so much faster to iterate.
The title implies cannabis involvement in the crashes, but this is not at all clear, from TFA:

Most cannabis tests do not distinguish between any past use and acute intoxication, and implementing standardized thresholds is challenging due to tolerance from regular use.