skysight-inc/HackerNews huggingface dataset:
Ask HN: What can we do with 20B links from sites
Hello, geeks of the world. It's my first time writing here. I and my friend developed a project that receives list of domains like www.wikipedia.org(example, example!) and saves all of the links in the html of it's starting page.
Sorts them into images, internal site links etc. We had list of like 200 mil domains and we parsed them all, resulting in 20 billion links from sites paired with source domains and sorted types.

We also found a service that can provide domains that are newly registered and domains that recently died, so we can keep our database up to date and even generate regular reports that state changes, improve sorting of result links, and write custom processors for clients to get more data from sites that meet their criteria.

Our thoughts were that we could query links to word press plugins used on sites and generate reports for commercial plugin developers, with regular updates about who uses, who are new users and who stopped using the plugin. But we haven't sent out many emails, so no answers yet.

Example of the juicy part of our data:
{

"source_url": "http://www.wikipedia.org",

"source_domain": "www.wikipedia.org",

"destination_url": "https://creativecommons.org/licenses/by-sa/4.0/",

"destination_domain": "creativecommons.org",

"link_type": "EXTERNAL_LINK",

"anchor_text": "Creative Commons Attribution-ShareAlike License"

}

Please help us gather ideas who could be interested in such data and possible insights(leads from sites using competitors, sites using your plugin what plugins get combined with yours most often, which sites are most referred on others, which have contact forms or contact us pages and collect these forms. Google analytics, google ads usage. Does site have links to Google Play and or App Store. Links to social media sites and which SM accounts are most often found on sites home pages) We're sitting on a well of information and we don't know what to find from it and what people would be interested in. Damn, we could be doing graphs and maps and we're just sitting here "ehh what would be interesting to people" with a lot of "m"'s like that doggo.

Help us find ideas what to do with that data and who to target.

If you want to get such data to do something fun, write us, we can devise the query and send you the results no problem)

Thanks a bunch! Looking forward to your comments
Can't use 'tar -xzf' extract archive file
This is also why I don't understand people who insist we need to read the original philosophy texts.

I can't. I tried reading e.g. Plato and I just want to argue with him forever. He starts with assumptions which were "obvious" then, but are just obviously wrong now. It's much better to read a modern interpretation / summary which takes the bits which are still relevant, and Contextualize them with what we know today.

(Note - if you want to study history of something, by all means do read original texts. But if you actually want working knowledge of the subject, it's a horrible horrible way to go).
The internet archive became almost impossible for larger uploads recently. Not sure what's going on there, but it seems that both using the command line app as well as the web uploader is extremely slow and larger files will just get a "network error" after a while. Searching for this issue I've seen it's fairly common. I imagine uploading an entire "video museum" is going to be a nightmare if it's even possible in the current state of the archive.
All TV and movies should be mastered on the cheapest Bluetooth speaker from the local Walmart or whatever.
A lot of trivial plumbing work is really being solved by LLM's.

Even in the space of work - We need a lot of plumbing knowledge to get access to a domain e.g. learning about the basics of beekeeping or how to build a nodejs based webapp which makes an API call - a lot of knowledge in a domain is just grind and grunt work which is being automated.

We now need to peer beyond and that's where true exploratory work in any domain lies and is useful.
One point where I would argue wget doesn't have a sensible default is on filenames - it really should make --content-disposition the default, at least for single file downloads. Otherwise it will often use the wrong name if there is a redirect or similar in the chain, which seems increasingly common.
The article claims to be written by a 16 year old. I'm at least as concerned about the way she's been indoctrinated with such an extremist viewpoint and all the talking points she raises as I am that she's seen porn.

I've been reading this kind of article for about 30 years, that modern porn is more violent, more unrealistic, worse for kids than furtively reading playboys. I know accessibility is higher, but I think the article is painting it all with the most extreme brush possible, and it makes it read like a moral panic rather than an objective assessment.

I don't look at porn and have never been to pornhub, so maybe I'm out of touch? It's really the fact that I see these arguments over and over again that I'm suspicious.
I do know how, as I listed how to in my original comment: using Pin. It's just been very unergonomic in a couple cases because I don't actually care in some of those cases of the struct is copied, I just want know when &self's bit pattern changes and there's no way in rust to know that.
> but I don’t see how that’s relevant to the employer not paying the negotiated amount.

Jalopnik ownership is notoriously anti-union. They take a lot of swings like this.
I received a message from
ChatGPT on Friday telling me about Enterprise access, where restrictions on text entry are unlimited. No price quoted sadly.
Not sure why you're talking about 'conflating with burning fossil fuels'. I didn't do that and neither did the paper. It seems like you're not read up on the topic.

Staggering amounts of methane and nitrous oxide. Massive deforestation and other habitat loss (read: reduction of carbon sinks).
When people appeal to authority it is important to include context which fully describe the view and perspective of said authority so that the information is not just correct, but given in context so that it is not misleading.

When scientists discuss diet in terms of global warming, part of that discussion include fair wages, ethnic discrimination, inequality, land ownership, ethnic heritage and culture, biodiversity and many other similar topics. All those influence how animal agriculture effects climate change. The global consensus is however very weak the further one goes from fossil fuels. Fossil fuels impact on global warming is an established fact in the global scientific community, as well as the requirement to stop burning fossil fuels. Inequality is also a fairly establish contributor to global warming by itself, but the exact solutions does not have a strong consensus.
https://github.com/konstantintzt/planetracker/blob/9a1f407cb...

At least this person does not fetch all planes and then iterate over all of them but sets boundaries in which area to get all the planes.
What do you mean by this? When I was freelancing the taxes were very steep (US). I felt the system promoted people working for corps.
They're pretty clear that that's not possible with the current state of affairs. They're speculating about a future in which that may happen, which seems pretty reasonable to me - we don't know how much gas is left in this tank, after all.
The industry bar is low: Is it any better than MDE?
Ask HN: What do you think about productizing your services?
So instead of charging per hour or per project you charge a recurring fee.

I'm seeing this model all over Twitter.

Includes:
- One request at a time
- Unlimited brands
- Unlimited users
- Unlimited stock photos via Shutterstock
- Pause or cancel anytime
I hit my first roadblock in React -- I had a list of objects each had lists in them (list<Post>, Post has list<Replies>). I wanted the UI to update when a reply is updated. This isn't straightforward, https://stackoverflow.com/questions/43040721/how-to-update-n...
All media outlets are biased. The point is to extract the facts and not get swayed by biases. No matter which news outlet you go to, you'll still see the same facts, but the opinions may differ.
It’s a series of small trucks
So, despite all the FUD by Big Oil, scientists were pretty much spot on, even back then.

Such a shame we wasted 40 years because the profiteers didn't want us to know the true extent of their crimes.
It would be nice, though, if we could actually observe the training data distributions, alternatively exploring it through the use of the chat interface itself.

Right now, without even being allowed that extra digging, it is darn difficult to be sure about its high-dimensional musings.
Interesting anecdote! Thanks. I would have definitely assumed that at least train gates (but not buses I guess) would attempt a hold!
Agreed. “Built” is definitely the wrong word here.
I do not remember what AVR does. In recent years I have used mostly ST microcontrollers and all of them had Schmitt-trigger inputs on the GPIOs. Obviously, for any microcontroller the datasheet must be checked when a schematic is designed.

The output of the noise amplifier is quick aperiodic oscillation centered on a value that is not a valid logic level. There is no guarantee about how fast will be the transition times between the logic low and high levels.

For a gate with Schmitt-trigger input, it does not matter whether the inputs have valid logic levels or not.

On the other hand, for any standard CMOS logic gate, there is a maximum time during which the input is allowed to be not valid. If that maximum time is exceeded, then there are no guarantees about the power consumption of the gate and there are no guarantees that latch-up (an internal thyristor short-circuiting the power supply) cannot happen (in normal operation, only one of the two transistors of a CMOS inverter is on, while the other is off, so only leakage currents are consumed; when the input is invalid, both transistors are on and an unpredictable current passes through them; the time while the input is invalid must be limited, so that the transistors will not overheat).

Of course you may be lucky and nothing wrong will happen when a certain CMOS gate will have an invalid logic level at input. However, such a schematic would never be acceptable for a product made in large quantities, because it is unpredictable how many will fail and when they will fail. Moreover, if such a schematic would be used with a power supply that does not have overcurrent protection, it could even be a safety hazard.

The older bipolar gates like 74ALS04 do not have this problem, but their more modern replacements, like 74HC04 or 74LVC04, must be used as in their specifications, they are much less forgiving of being used in undocumented ways.
Idk what the author is referring to specifically but I can speak to my experience. I've been running a few single-node k8s clusters for a few years now. On GCP, the control plane fee is waived if you're running in a single region (no $70/mo fee). So basically you only pay for the VM itself.

As a solopreneur, I've saved so much time and money letting k8s run my workloads while I rack up billable hours and build products.
That's awesome, but I sincerely hope you are also saving enough to retire. Each to their own, but I'd work 20hrs vs 10, and half my career.
Question: the post says Cola only concerns itself with making conflict-free edits to unknown datatypes (just streams of characters & their locations).

Couldn’t formatting be represented in the text itself the way html does it? I honestly don’t know much about other rich text representations.

Edit: the Peritext doc linked above talks out exactly these unique RTF challenges. Very interesting read.
There are posts where people tried to create a programming language with chatgpt:

- https://smaller.fish/posts/l_plus

- https://www.kdnuggets.com/2023/04/datalang-new-programming-l...

- https://github.com/forrestchang/gptlang

- https://6502.is-a.dev/posts/aoc-2022/
Also (annoyingly) URL params
Imagine wearing a Garden Cress hat 24/7. It grows fast and new batch is ready to be eaten every 2-4 days. Thats ~10 calories for free per day, FREE sun energy! Hat weights a pound and you cant take it off, even at night.
Be suspicious of simple stories (2009) [video]
Are AI models doomed to always hallucinate?
Court historians telling the stories the ruling class wants in an effort to buttress their legitimacy is absolutely not new.
> Just because you don't like the law, it doesn't mean you can break it without consequences.

However, laws aren't necessarily ethical and it's arguable that good citizens should refuse to obey unethical laws (e.g. it used to be illegal to harbour an escaped slave, or the Nazi Germany laws against Jews).

Personally, I think that media companies are harming the public by enforcing unnecessary old copyrights that they have no intention of re-distributing. We're going to end up with missing decades of TV/films that aren't popular enough to interest the copyright holder and that no-one had copies of.
Ask HN: How early in a new startup do people think about subscription billing?
Yes, that would be a whole lot better for India.
I have had a similar experience using ChatGPT to build https://meoweler.com – a travel website covering 5000+ cities with a surprisingly good content quality created over a long weekend. Something that was unfathomable for me 2 years ago.
https://www.khanacademy.org/khan-labs

https://www.ted.com/talks/sal_khan_how_ai_could_save_not_des...
One handed power might be less common. But 1 handed backhand slice is very common for players with 2 handed topspin/flat backhands.

This is a common trope that gets thrown around in tennis. Anytime Federer struggled, analysts would have this great hot take, "We will never have 1 handed backhand mens grand slam champion ever again."

Then, Stan Wawrinka wins 3, Dominik Thiem wins 1, and Federer's dominance would continue..

The one handed backhand has always been less popular, which is why I think 'analysts' say its dying. But there are plenty of players crushing 1 handers on the tour right now and there will continue to be in the future.
I agree with this statement.
My personal experience has been creating MongoDB statements, the easy ones are more or less good, with only a few changes necessary. But if I need a complex one it is always incorrect, it is not able to produce it, no matter how I structure my prompt.
Not only are you wrong, I had the opposite experience - whether was all well and good for downloading pages, but it fell over for making e.g. authenticated POST requests. I think that might be possible now/have gotten better, but wget has always been too restrained for me.

I am in agreement that wget has "sane" defaults i.e. it acts like a bot or web crawler, or basic browser. Curl has always been easier to get things done with, though. At least in the land of http requests.
It's standard substandard antiunion Jalopnik shoveltext, did you expect reporting?
Raytracer seems to me to be a trivial task. Maybe try it with CHATGPT.
Crucially important as well is the following:

YTMND - Tubular Nets

https://tubularnets.ytmnd.com/

NSFW btw.
From my experience, you hit a wall quickly. You get an error, you tell ChatGPT, it tries to fix it, it can't. Now, you must learn everything ChatGPT wrote, in order to fix the error/bug - just as the Romans did.
Or we might have a bunch of other streaming provider none of them in any way directly related to Blockbuster/Netflix.
A nice writeup and good observations about what makes a picture interesting.

For a brief period of time, I did a "take a picture every day".. thing.. I forced myself to capture, develop and publish a picture every day. I didn't write much about the process or if I learnt anything (I might haven't), but I basically brought my dslr to work every day and for the daily after-lunch walk, I took a picture of.. something.

Here are the images, in case anyone's interested http://dusted.dk/pages/picture-of-the-day/
#1 ?

#2 It's a surgical implant, why would they remove it?
Nobody can prohibit the preservation, that is to say archiving, of copyrighted works. This right is protected by the law, at least in the US which is relevant here.

What is prohibited by law is distribution of copyrighted works. You need permission or an appropriate license from the rightsholders concerned to distribute or otherwise perform a copyrighted work in public.

It is nearly always the latter that a lot of these so-called "archives" trip over. Everyone, including Big Corp, is fine with having their copyrighted works preserved.

Obligatory IANAL.
Yeah, it looked like a demo of something they're still working on.

In this video they say "Custom-tuned models on code" are coming soon, but aren't there yet: https://youtu.be/qbxj_JDQ4Lk?si=qSTzMBpmqqJD5o9u&t=1632
There's no reason this machine would be good at difficult tasks - they are usually somewhat bespoke, require true creativity and understanding of complex requirements, and oftentimes you'll have no example on the internet - normal programming things.

However, there's many reasons it would be good at trivial tasks, and arguably most programmers spend most of their time on said trivial tasks, its just the count of them that's overwhelming; switching between multiple different languages, looking up syntax (at least for me!), and deciding on what's a sensical solution for the use case. Nobody cares about the performance characteristics and just wants it to work.

So anyway, I don't think a blog post about how you build a new algorithm to come out of any of the LLMs of today, but that doesn't mean I find them underwhelming.
Huh, somehow I missed that bit on reddit. As for Discord, I tend to keep my interactions there to a minimum, so not suprised that I missed that.
The thumb cluster on Advantage is simply too high. Glove80 solved it.
The local used-media store (2nd & Charles) isn't buying right now because they have cartons of DVDs/Blurays in their back room and no more space for more. So they ought to be willing to discount. I've never gotten a bad disc from them.

https://www.2ndandcharles.com/movies-video-games-more-dvd-bl...
See my last paragraph. The chances of a kid dying is extremely low. The paranoia, fear, and desire to make it safer have caused many schools to feel like minimum security prisons.
Odd. I can get asn unsigned, un-notarised app running just fine. I just need to hold control while opening it for initial run. Something odd happening here.
How can you tell the difference between the parts of the hallucinated answer which coincide with reality and the parts of the hallucinated answer which do not - when you are entering an area you don’t have expertise in?
As a solopreneur using tiny k8s clusters, I agree wholeheartedly with #3 and #4 of your list. I don't think #2 is necessary and #1 is probably a good choice if you haven't already jumped onto the k8s bandwagon.
Same reason you dont have a vertical strawberry farm in your bathroom and living room.
What else do they rip apart?
I don't think the Mensagem is primarily a historical work. Rather, it describes a spiritual path, using symbols drawn from Portuguese history. The problem isn't so much the required cultural background; because it builds on the Portuguese posture in life, the book is utterly opaque to foreigners, even more so than the rest of his work.
I have used ChatGPT to help me brainstorm and do quality checks on my Masters work. It also is good for hallucination where you have to come up with a hypothetical project. For example, I had it generate me parts of my project given characteristics or attributes. It came very close and with further and further prompting on the same window the responses got better and better.
Energetic Agriculture: Electroculture and Magnetoculture
I worked on a porn blocking app a while ago and pornhub (modern porn sites in general) is definitely not equivalent to "furtively reading playboys".
Seriously. I can’t imagine how trivial it would be to just add a flag to my YouTube account permanently disabling shorts but they’d rather make it per device, per 30 days. Forget what we want to watch, we will use YouTube they way their PMs want.
Yeeeeeah. Honestly don't know if I will keep using it if/when they remove old.
I'm building Shpong[0] with a fellow HNer. It's a publicly accessible Matrix server with reddit-like features. Not quite ready yet, but almost there...

[0] - https://shpong.com/shpong
It worked in that Sampras won Wimbledon seven times, but he never won the French Open. And Federer only won the French once, when he didn't have to face Nadal in the tournament. Most impressive IMO was Wawrinka's win in the French over Djokovic. (And I should note that Wawrinka appears to have a lot of brute strength in his right arm.)

The backhand was IMO the weak part of Pete's game. Of course his serve was monstrous, overhead was monstrous, net game was good, court movement was off the charts, running forehand incredible. His running forehand provided a lot of cover for the backhand. And as a serve and volley player, he didn't need the backhand as much as other players.
> Yeah for sure - if people outside of China and their sphere of influence can get hold of a device to do impartial testing.

That's exactly what the article you're commenting on is about. An independent organization in Canada just did a teardown of the new Huawei phone, and verified that it's using a new SoC manufactured by SMIC.
The biggest difference is that with pretty much every car that's not a Tesla, the driver still needs to drive the car. That's true for the Tesla, too, but "full self-driving" makes it sound like it's different.

Mercedes brought out their first actual self-driving car a few months ago. Unlike driver assistance, where the driver is expected to retain control at all times, it will give at least ten seconds notice -- so you're allowed to take your hands off the wheel, read a book, or watch a video. But it will only let you turn it on in very restricted circumstances.
I'd still rather not be breathing someone else's used strawberry flavor though, regardless of health effects or lack thereof.
How did you decide to mine this data specifically if you have trouble finding a market for it? What was the insight?
It's not about building a product, it's about saving time by making it do small task 30x faster than yourself (just like author did). Not all tasks, but many many menial tasks.

At least that's how I use it and I'm super happy with what it gives me.
Except that most stuff I’d want to watch isn’t available on $streaming_service, and often enough on none of them.
For the intersection area, I see no reason to use curl or wget over requests / urllib. Assuming one is inside a script.
I don’t think it’s as evil as it is myopic. This story is specifically about ignoring long term effects to an entire ecosystem to sustain operations that are apparently not sustainable without sacrificing an entire ecosystem in the long term.

Industrialization is nearly always the practice of punting long term issues to another part of the world or to another generation.

I would assert that most industrialists are looking to maximize profit through economies of scale with little to no concern for sustainability. That’s how it started and I think that’s how it ends.

So, I guess maybe being myopic at scale is evil.
So the teachers have to check the results of the pupils and additionally the results of the AI
You can't, which is why I'm not too worried (at the moment at least) for my job. It's currently a boost to people already knowledgeable in the area, but people with a lack of understanding of the underlying principles quickly become stuck.
Love the update from a year ago where you need to click through 3 layers of settings to run code someone else wrote on MacOS now.

And on the other end, window's UX is going down the drain year over year.
Yep. Humanity is collectively so, so astonishingly stupid.
Yes it does. How does the wget --continue work?