skysight-inc/HackerNews huggingface dataset:
Show HN: Generate Web Scrapers for Any Website with GPT
We got frustrated with the time and effort required to code and maintain custom web scrapers, so we built a more generic LLM-based solution for data extraction from websites. AI should automate tedious and un-creative work, and web scraping definitely fits this description.

We're leveraging LLMs (GPT and fine-tuned Flan-T5) to semantically understand websites and generate the DOM selectors for it. Using GPT for every data extraction, as most comparable tools do, would be way too expensive and very slow, but using LLMs to generate the scraper code and subsequently adapt it to website modifications is highly efficient. Extracting and transforming data is one of the underestimated superpowers of LLMs.

Try it out on our playground https://kadoa.com/playground (OpenAI key required) and let me know what you think!

Here is a rather impressive example of extracting gaming stats: https://www.kadoa.com/playground?session=e1226fa8-9fa2-4eba-...

There is still a lot of work ahead of us. Extracting a few data records from a single page with GPT is quite easy. Reliably extracting 100k records from 10 different websites on a daily basis is a whole different beast:

* Ensuring data accuracy (veryifying that the data is on the website, adapting to website changes, etc.)

* Handling large data volumes

* Managing proxy infrastructure

* Elements of RPA to automate scraping tasks like pagination, login, and form-filling

We are spending a lot of effort solving each of these points with custom engineering and fine-tuned LLM steps.
There's a somewhat famous (possibly apocryphal?) story about the USSR's campaign to get its hand on American minicomputers to reverse engineer. The CIA would intercept shipments they suspected were being sold to the Soviets and fill the boxes with rocks before sending them along to be picked up by KGB agents in South America.

Ultimately the Soviets did end up procuring a few western machines and reverse-engineering them. This is a look at one such machine - essentially a desktop PDP-11 used by the Soviet nuclear power industry: https://www.youtube.com/watch?v=r1EWsWxObjA
> but what is the point of bringing his grudge with Trans?

Let's not pretend like he just has a "grudge" with trans folks. It goes many orders of magnitude beyond that. Perhaps he was not, and maybe he even still is not a transphobe, but right now he's tweeting like a full-blown transphobic maniac on Twitter. [1] That's a severely negative personality trait. Discriminating against a group of people simply because of the way they were born goes against the fundamental values of the Western society, freedoms, and should be criticized harshly at any avenue. It's relevant here, not because of Musk's speech (which I firmly believe every person is entitled to), but because Musk is an influential figure who contributes so much thought, inspiration, motivation and soft/hard influence to the world that it must be noted he's actively acting like an unhinged transphobe. This can be harmful to people and too much influence from a transphobic personality can be harmful for the society, in turn. Just like, a lot of influence from good people is good for society, a lot of influence from bad people is bad for society. It's worth noting.

[1] We saw, in many instances not only Elon Musk but many other people exaggerating their personalities and beliefs on Twitter.
My mind is so blown. Definitely disappointing, but let's be honest: this is a win for SpaceX, given that this was the first fully integrated flight test of a very complex, very unproven vehicle. (Yes, the ship has flown before, but this was the booster's first flight.)

Did anybody else notice the Apollo-style maneuver to avoid the launch tower?
Thank you!

I love the Wayback Machine for this!
That's not being contested. What will be in conflict, I think, is engineering versus how that engineering may be perceived. Given enough time, investors and critics of government subsidies may also question whether "failure success" became an excuse.
Right but you have to be really careful with that use.
Grambank shows the diversity of the world's languages
"What shapes the structure of languages? In a new study, an international team of researchers reports that grammatical structure is highly flexible across languages, shaped by common ancestry, constraints on cognition and usage, and language contact. The study used the Grambank database, which contains data on grammatical structures in over 2400 languages."
They are very limited in space due to environmental regulations so it is difficult to expand.

It is also worth noting that liquid methane is not explosive by itself.
When I worked in the office I drove home during lunch, let the dogs out, scarfed down food for ten minutes, then headed back to work. I know others that just cage their dogs for eight hours (which I would never do to my dogs) or took them to doggy daycare every day, which the average day-rate around me is $40/day per dog (and I have two dogs, so it would be $80/day, or $1600/month).

My new job is downtown and at least an hour drive away, so I couldn't feasibly drive home during lunch anymore. It would be a significant inconvenience for me to start going to work every day (or at least it would if my wife was also forced to go back to work, she currently works from home also).

It's also inconvenient for many other reasons, including a 2-3 hour commute, but yeah, having dogs complicates things, and pre-pandemic, there were very few remote jobs, so people just had to deal with it. But it still sucked.
Replying again since I didn’t manage to re-parent my comment fast enough! I suspect based on your username that we share some common interests. If you ever want to chat about these topics and the things pushing (pulling?) me in this direction, ping me (email in profile).

Best of luck on your journey.
Spectacular all the way around!
Actually its more like your project is ahead of schedule and is meeting budget targets.
> To use a VPN correctly wouldn't have to use a fresh OS and absolutely not login to any accounts connected to the IP you are trying to hide?

Even then fingerprinting would still present an issue, even without explicitly logging in, with most browsers.

For example: https://coveryourtracks.eff.org/

Also have a look at this: https://www.amiunique.org/

So you might need to have a browser that lies and presents configuration information that is common enough not to be unique, probably an OS inside of a VM might be one of the possible starting points. Outright denying access to some of that might actually help identify you, but pretending to be a common setup might not even work that well.

I'm frankly not sure whether privacy on the web is even truly possible nowadays, at least without a lot of effort. Even with a VPN, I treat the web as something that is more or less "spying" on me regardless, in the metadata collection and storage sense.
Huawei is no more an arm of the CCP than any other Chinese company, and neither are they operating a "giant spy network" through their equipments. Please refrain from spreading the basic propaganda you're being fed.

Huawei does not answer to the West and has become too big in a strategic industry so the US took steps to attempt to kill it. It is simple geopolitical power struggle.
The Case for Ethernet (2021)
Absolutely! Applies to everything too, including the project you bought a domain for and didn't do anything with!

You there, reading this comment, go and fail or go and turn autorenew off :P

Failure > inaction. You can learn from failure.
I'm saying the tech is not germane to the question of whether or not this was deceptive or illegal, the tech amplifies the effect.
It is harder than I would have imagined, it is a weird thing.

Do you mean use the full URL in image references? If so, why exactly?
> uhm actually, it has everything to do with it. Calories in, calories out.

Uhm actually, CICO has two variables, and you and others only concentrate on the first one, when the research is pretty conclusive that hormonal changes affect the latter one.

How do you think PCOS causes obesity and semaglutide helps with weight loss? How do you think stimulants help with weight loss, for that matter? The over-focus on the first variable is because it's the variable which individuals have the most self-control over (e.g. they can simply eat less). Even that is starting to be disproven, because hormonal shifts can drive hunger and hunger pangs are subconscious. That's why appetite suppressants are also an important way to treat obesity.

So "uhm actually", it's not just the calories in that matter, it's also the calories out, and there are many factors you are dismissing to calories in.
Clamps were released at T-10min. IIRC compensating for engines are pretty fast. But they hold the engines at just below lift/weight to run some more checks before fully powering up.
That function always struck me as an oversight rather than a feature, since the rest of the product is oriented around only being available "in the app".

Personally I am running a mediagoblin server on a Droplet but I have a feeling that only works as long as nothing I make ever goes viral.
SpaceX is successful despite of Elon Musk, not because of Elon Musk. SpaceX spends a lot of energy keeping Musks's insanity and emotional outbursts at bay. Tesla has also learned how to manage Musk, though not quite as successfully as SpaceX. Twitter is still figuring it out, but I'm sure that they too will learn how to manage Musk.

I think it's useful to compare Musk with fire. Fire is useful, if controlled. Fire can be very damaging if not controlled. You have to control Musk while giving him the semblance that he's the one in control. Kudos to those who've successfully been able to pull that off.
The final paragraph makes clear that he is pull back specific things that Twitter used to offer to trans people:

> Twitter hasn’t completely pulled protections for trans users, however. Its Hateful Conduct Policy still explicitly prohibits attacking others based on “race, ethnicity, national origin, caste, sexual orientation, gender, gender identity, religious affiliation, age, disability, or serious disease,” but the choice to intentionally remove all mention of misgendering and deadnaming seems like a calculated jab at the trans community.

I am not an LGBT+ person, but I also do not support targeted harassment of various segments of society just because they are different.
Isn't the drinking the best part?
> abusive material which is hard to detect and process

But doesn't all NSFW content just expand the range of what you have to detect and process?
Disagree. I've had them in Saigon in addition to here in the States, and a good banh mi roll is much crispier on the outside. That's not the texture you want for a cheese steak -- it has to be really soft.
Traditional ciabatta is a very wet, kinda shapeless dough; hydration level is high enough that it can't really hold a shape outside of flat blob. High hydration makes it easier for the yeast to eat the carbs, and allows the loaf to absorb more air.

Hogie rolls are long and soft, closer to baguette but with softer (less protein) flour and some light steam during the bake.

You could probably hack it with a baguette recipe subbing some AP flour, and baking at a slightly lower temp with a pan of water under the baking sheet.

edit: I also had some success in the past with a naan recipe that I didn't have time to cook w/ a flat-top, and rolled into vaguely hogie shapes. It had yougurt and a small amount of canola oil, which kept it soft -- that might be an option.
I watched some of that video and the guy seems burnt out.

He was in the same sentence saying one thing and then the complete opposite. He also seemed far too emotional about things to be a CEO. People questioning his education is because his degree is in Geography. He could have a reasoned response to that for example that he's a business man and the reason he is CEO is because of his business experience not his education but he totally whiffed and just started getting upset about the personal attacks.

Some of his points were salient and others where unhinged rambling nonsense. He's a serious danger to the company and the exec board have a fuditary responsibility to stop him doing anything reckless (like this).

If the board was sensible they would get rid of this guy, he's a major liability.
Here are 2 accounts:

Tucker Max wrote at length about mdma therapy. [1]

Vice News had a piece on mdma therapy and ptsd. [2]

[1] https://www.tuckermax.com/what-mdma-therapy-did-for-me/

[2] https://www.youtube.com/watch?v=DAvUDRYg4h4
especially if the CEO is smoking weed
Shotwell is also awesome, that is certain. They all are. I personally think the first man down the ladder on mars should be a woman, and it would be great if it were her. However, Elon founded that company (and personally hired Shotwell) and has been a continual source of engineering inspiration, for several decades. His direction has pretty much forced the global automotive industry to go electric. People may not like some of the things he tweets, but at the end of the day, he is not going to be a historical footnote.
Reading the court paper that someone else (wildrhythms) linked to (thanks):

http://citoyens.soquij.qc.ca/php/decision.php?ID=8DC675577FC...

it is trivial (at least from outside Canada) to find via Google the actual post using some other keywords (instead of the anonymized name of the plaintiff).

The post, though clearly defamatory, is as vague and generic as such posts can be.

Without entering the debate on the actions or lack of actions by google and/or the actual site publisher, what I find almost incredible is that it had such a heavy impact on the plaintiff (see the court paper points [407] onwards) and his reputation.

To only list a few, being removed from advisory board of an institute, being not recommended by old time friends for some jobs, the parents of his son's fiancee refusing to meet him, having promising business agreements canceled, influencing the reputation of his sons, the list is long.

All for a single anonymous post? (presumably from a disgruntled ex-worker)

Are people so stupid, do they believe the contents of this (single) data point and as a consequence take the actions that have been described?

EDIT: corrected "removed from presidency of an institute" to "removed from advisory board of an institute"
This is web 4.0, also known as WWBWW. World Wide Bubble Wrap Web.
ChatGPT can't even do sensible NGINX configs, despite feeding it documentation. Gets URL rewrites wrong et al, hallucinates things that aren't even there. Troubleshooting its output is more labour-intensive than just doing it right in the first place, but most folks' Dunning-Kruger complex prevents them from knowing when the output is wrong in the first place.
There’s the difference between being a writer and managing writers. If you are writing yourself it is at the speed of thought, if you are hiring somebody else to write you can possibly free yourself up to increase your throughput but you are going to spend time communicating expectations and reading/editing the results. If you develop a good relationship with the writer the effort to do all that can be small but if you don’t it sure can be tiring. (e.g. the New York Times has a strong and consistent style enforced in editing, people who write regularly for that paper learn to write in that style to make the editor’s job easier, people who write occasionally for that paper get their work seriously mangled by the editor)
I should have realized you were quoting a bot, but my mind was literally contorting itself to figure out how that was accurate. :D It felt like the eyeballs of my brain were quite literally full open and blinking in confusion.
He's been saying this for literally years. That the pad is stage 0 and if they don't blow up the pad, they're happy.

I think he said the exact same thing about the first Falcon Heavy launch.
What I'm finding it most useful for is grokking some new subject rapidly, so the output multiplier is directly related to how well i know the subject im working on. At work, I know the tech stack pretty well so I'm not finding it that valuable, i use it to remind myself of bits and peices here and there.

In my free time ive been working in some areas and frameworks i dont know at all and the output increase really is crazy. i was playing around with pixijs and very rapidly had a basic UI cobbled together that would have taken me at least 4-5x longer if id had to read through different docs, blogs, etc. its making me much more willing to try new frameworks and ideas out that i wouldnt have before because of how easily i can get over blockers in my concept of how something works.
Yeah, starship has a ways to go to beat the N1's body count.
Russian snoops just love invading unpatched Cisco gear, America and UK warn
The 4/20 launch date was purely coincidence.
It is extremely heavy and the engines do not all light at once, they sequentially start over 6-8 seconds.
It’s a function of area so if we scale equally in both dimensions, a taper ratio of 10 means a thickness ratio of ~3.2. But yeah, that doesn’t exactly buy us much.
at some point, http://www.coboloncogs.org/INDEX.HTM will cease to be parody.
NSO Group escalates spyware tactics with 3 new iPhone zero-click exploit chains
The answer almost always seems to be ice, or a stiffener.
It isn't like he's contributing to the company anyway
Dupe: https://news.ycombinator.com/item?id=35640002
I thought they were very clear on how they defined "success".

This is progress, and admirable, but not a success according to their previous statements.
Why does it have to be a significant percentage of the total? It's still contributing to avoidable life-changing trauma for the people involved.
If they sold $1.1B in drives, then shouldn't the fine be larger than $1.1B?
Show HN: Plane - Open-source, self-hosted alternative to Jira
Hi HN,

I'm Vamsi, the founder of Plane(A simple, extensible, open source project and product management tool). Today, I’m here to share our journey with you all.

It all started when we identified some of the most frustrating elements for teams when managing projects, especially with tools that force users to learn complex frameworks. We wanted to create something that was intuitive and easy to use. That's how Plane was born!

We first open-sourced Plane back in November 2022, and the response was great. But it wasn't until we announced Plane on Reddit in April that we saw an incredible surge in popularity. In just under two days, our stars skyrocketed from 150 to 1000+!

Today, I'm thrilled to report that over 1000+ users are actively using Plane, and many are using the self-hosted version. Our approach is simple yet effective. Despite adding multiple layers of abstraction for project management, Plane operates around the central concept of an issue, similar to a block in Notion.

As we continue our journey, we know there's still a lot more to build. We're grateful for the constant feedback we receive from our open-source community, as it's the reason why we're here today.

We value your input and want to encourage you to share any feedback you may have. Don't hesitate to ask any questions you may have, as we're more than happy to answer them.

Thanks,
Long time user of ALIX and APU boards, and Soekris before them. Very sad to see this news. You will be missed!
i'd imagine this margin would be different per mission taking into consideration the payload weight, the desired altitude, etc.
Not double speak. Just terms you are not familiar with.
China is not inherently hostile to the US. They are strengthening and have more resources to assert themselves like any country would and should, which is actually what the US are hostile to because they don't want competition.

On the other hand, if the USSR's aim was world revolution then yes they were inherently hostile to the US.
Anyone reading the headline could easily be misled: this was a massive success. Some context:

- This was the first "integrated test" of the Starship space craft with its booster

- The whole thing together was 120 meters tall

- It will be one order of magnitude larger than the current largest rocket in terms of carrying capacity (~150 tonnes if it needs to return the booster, 250 if it doesn't)

- There's 5 more of these being built right now so the next tests can be done soon
hmm which OSX / iOS versions are you on? The OS-es I mean?
the latest ones? I'm on latest and it's been smooth sailing with 1P, but reading your comment, I am concerned I may be overlooking something, especially in the "sync" space as those kind of issues may creep up on you undetected
I personally use a bunch of VMs for web browsing, all with different exit IPs.

And yes, a lot of people use VPNs but don't use them correctly. But I'd rather help them to use them more effectively, rather than shout down that VPNs "don't work". And even when they're not used correctly, most people don't have particularly omniscient threats. And even imperfect use still helps everyone else by creating cover traffic, a fluid market for VPN services, and more evidence to websites that (IP-based) nagwalls hurt legitimate visitors.
Tor exists, but realistically the overhead of using Tor is not acceptable to the general public. As long as Tor is sufficiently slow compared to everyday traffic it will remain a niche use case. A good VPN on the other hand gives you at least a little bit of privacy without much of a cost.
Spent a lot of my youth staring at this screen. Still remember the bong sounds it used to make
How could this be a success? It was a catastrophic failure. Sorry but bullshitting releases only works in software.
Some places passed laws during the pandemic allowing for the execution of a will using witnesses connected via video link. How does that sit with you
Hey, I remember this site! Definitely a cool place, when I was in high school and interested in technology and P2P it gave me a place to find torrents to experiment with, without the risk of getting in trouble with my parents over illegal downloads. Also found some cool open source software and CC-licensed music (mostly nerdcore rap lol) in the process.
Hikvision: Chinese surveillance tech giant denies leaked Pentagon spy claim
A new murder mystery novella has an unusual author: three A.I. programs
they said it would take ~6 seconds from engine ignition to takeoff in one of the streams. everything was working as planned at that point afaik
> we need professors who avoid politics entirely

We desperately need that, yes. It is much too late, unfortunately.
This was pretty much expected. This flight was to gather data and not much else.
Couldn't disagree more. The biggest innovation that SpaceX has brought to the table is the reusable nature of their platform, both reducing operation cost AND in reducing R&D costs. I believe one of the biggest contributors to the lack of space exploration and exploitation was the astronomical (pun totally intended) cost of both developing and operating the platforms to get us there. If this helps fix that, blow some stuff up!
Anytime there is discussion of China here, you can set your watch to the whataboutist replies rather reliably.
It sounds like they achieved what they were officially hoping to achieve. Everyone was cheering but Musk didn't look super happy imo.
As though hack journalists need actual reasons to write hit pieces about Musk. They’ll write them no matter what. The articles will generate plenty of clicks, they will have zero impact on anything that matters and they will change nobody’s mind about anything.
It's gender dysphoria...
Agreed that waste is overwhelmingly owing to the supply chain, grocery stores for instance.
If you do need someone to pick up the torch let me know. It'd be nice to keep cool stuff from disappearing.
How Tap-to-Pay Works [video]
As an anecdotal counterpoint, I find mingling with others to be excruciating when I'm depressed.