skysight-inc/HackerNews huggingface dataset:
> The Bytespider bot, much like those of OpenAI and Anthropic, does not respect robots.txt, the research shows. Robots.txt is a line of code that publishers can put into a website that, while not legally binding in any way, is supposed to signal to scraper bots that they cannot take that website’s data.

Does any of these scrapers uniquely and unambiguously identify themselves as a bot?

Or are those days long over?
Id say its like IMAP with a middleman who reads all your emails for you first!
Interesting ! Thanks for the explanation
Maybe the assembler?
You're engaging in explaining away intelligence.

One way to help you notice this is to try and estimate how many billions of people you've defined out of "being intelligent" with your latest goalpost movement.

Be honest, how many people do you think "introspect and continually learn" on a daily basis?
In your book, debugging problems is not part of maintenance?

What even is the difference, apart from trying to start a discussion about definitions (I'll let somebody else comment on that terribel habit: https://www.lesswrong.com/posts/7X2j8HAkWdmMoS8PE/disputing-...).
This one does and I blocked them categorically from all my domains.
> They definitely make traffic flow smoothly

They make slow or medium traffic flow smoothly. If the traffic is heavy, roundabouts make everything worst.
> You can look into the ascii table then.

I suggest reading the article, to find out just how badly you’re missing the point.
Context: Sorbet is also the name of a popular Ruby type checker[1], built by Stripe.

[1]: https://sorbet.org
Hmmm I don’t believe so? Zen is at least portrayed in its conclusion as a true, autobiographical story (with obviously dollops of philosophical musings).
Roundabouts are hostile to pedestrians. At a 4-way stop, cars actually stop, and they are forced to pay attention. A roundabout is just a vortex of confused drivers who are paying as much attention to what's behind and to the side as they are to what's in front of them. Much better would be to expand the roundabout and straighten its sides until it's a square block with one-way streets -- and so, no longer a roundabout.

The centers of roundabouts are typically overgrown wastes of scraggly grass mixed with litter. Each a tiny sacrifice zone. They remain that way because nobody goes there on foot. We just see the mess from our cars.

A roundabout takes what could have been a village green and turns it into something just barely less terrible than a highway cloverleaf.

...

So I actually read the article and am not really proven wrong. They do this insipid

> Making a roundabout for everyone

thing, like laying pavement is the Civil Rights Movement, but "everyone" seems to only mean "vehicles", a word I see several times, together with "drive", but never "walk". I see no crosswalks, no pedestrian flashers, and no bike lanes. And the center island has been designed so larger vehicles can drive over it; I understand their reasons, but that also means it provides less protection to anyone seeking refuge there as they try to get across.

Sometimes traffic isn't a problem to be solved. It's the universe telling you that there are already too many cars.
Nevermind your data. During natural disasters, as was the case in North Carolina, everyone loses cell coverage.
Notably though, it’s usually civil law. So someone would have to have standing to sue (typically family). And typically more
of an attractive nuisance type deal.

So it’s of the sort of thing where if someone is in your house, and falls off something and hurts themselves because of something negligent you did or whatever, then yeah they can sue for damages. Regardless of if they had your permission to be there, because you had a duty to not leave something obviously dangerous just lying there.

But it does lead to a lot of weird/unjust situations - either if the law does exist, or if it doesn’t.
> Check the first Unicode codepoints, 10 is defined there

The point is how the compiler knows that. Read the article.
Canada got rid of the penny for cash transactions. Problem solved
I'm also not sure what was "busted" here.
Probably have a chance at getting a nice discount on a refurb/discontinued model after the M4 comes out.
I recently had an unoffice hours with Matt Webb.

I originally had a specific agenda - to get a perspective on a core project with moral considerations. In between booking and having the call the project was written off. I kept the call.

It gave me the option, as someone currently freelancing and consulting, to talk to someone in a different boat, going to a different place, on the same sea.

Impactfully he gave me some simple advice that I struggle with - paraphrased "act in the open / people will find you". I've spent a great deal of time since struggling with it - it is a loss of control when being perceived, and flies in the face of a lifetime of believing in internet anonynimity!
Artist appeals copyright denial for prize-winning AI-generated work
Twitter is not Elon's [video]
Yeah, while they certainly try to push it, I don
t know about any Czech bank that would force you to use a mobile app.
Glad I noped out of this particular bad-faith subthread last night.

I am pleasantly surprised to see however that this unfortunate subthread produced interesting and well-intentioned comments from others.
>Open disdain for audience is rarely in the mind of the artist

Thanks to many artists being incapable of abstaining from Xitter loggorhea, we definitively know this to be false.
Republic of West Florida
Ask HN: Is Cookie Pop-Up Protection a Good Idea?
On my Android phone I've been using Duck Duck Go's browser for a while. By default it visits sites "incognito" and aggressively purges cookies.

Of course this results in sites not remembering your (GDPR) privacy preferences which would in turn result in those pesky pop ups every time you visit a site. To mitigate this, DDG offers a feature to automatically handle the popups:

When DDG detects cookie pop-ups on sites you visit it can automatically set your cookie preferences to minimize cookies and maximize privacy, then close the pop-ups.

Technically, it's far from the simplicity of something like DNT header, but it works reasonably well on a (small) majority of websites. I think this is because those websites use a standardized dialog, the remaining sites still require manual interaction with the pop-up.

What I've noticed recently in my own behaviour is that I tend to dismiss or ignore search results that DDG's pop up feature doesn't recognize. I.e.: I have a bias toward preferring sites that either don't have cookies, don't have cookie pop-ups or have cookie pop-ups that immediately disappear automagically.

So my question is: what if these kinds of tools gain wider adoption? Would that cause traffic to significantly decrease for sites with non-standard pop ups? And could that ultimately incentivize websites to tailor pop-ups to not annoy users? Any are downsides?
they say that is to save a few milliseconds on first load. My theory is that this is done just to secure some cloud lockin
Proposal of JavaScript becoming a compiled language: JS0 and JSSugar
Agenda: https://github.com/tc39/agendas/blob/main/2024/10.md

Slide:
https://docs.google.com/presentation/d/1ylROTu3N6MyHzNzWJXQA...

@nullvoxpopuli 's relevant post on X:
https://x.com/nullvoxpopuli/status/1842389133810913338
Maybe he means the mass extinction has already started (due to plastic pollution).
I saw this going under Tower Bridge last week! Made me late for the dentist... :)
Show HN: SEO Extension for Chrome
Seo sidebar thats shows on page seo information as you browse the web
I think dhh said, great frameworks/libraries are extracted, not created from scratch. That would mean, someone building a (successful, money making) web application in Rust and building their own framework as they go, open sources that framework and then continues using it for their production applications.

I have not seen such a success story for any Rust web framework yet. Although I would love to see one (or more!)
Emergency blanket requires no training but people need to know it exists and how well it can solve the problem of being cold. And also yeah you get soaked in your own condensed sweat.
https://archive.md/gWcYZ
That looks like a Hamburger Junction (or roundabout interchange https://www.roads.org.uk/interchanges/roundabout-interchange).

I think they're a bad design as they encourage drivers to go fast with the sweeping corners etc. Ideally, a roundabout should be designed to slow traffic joining it to reduce collisions and their severity. Trying to keep vehicles moving quickly at junctions is just asking for trouble.
they had to reorganize/laid off a large amount of personnel
The laser tech is a different thing within GoogleX
Absent things that are pure math isn't everything Humanity "knows" basically a series of, while highly supported by evidence in a lot of cases, just assumptions about the way things really work?
Spring Boot, Django, Rails, Laravel, ASP, ... it's not unreasonable to expect Rust to have an equivalent to something that most popular languages have.
ABOUT YOU is a company fueled by a passion for creating top-notch tech products. We’re currently looking for a skilled and enthusiastic Senior Platform Engineer (m/f/d) to join our team in the Commerce Business Unit. In this role, you’ll work on exciting projects, including scaling our cloud-based infrastructure to support our growing online shop customer base.

As a Senior Platform Engineer, you’ll be part of a key team that helps our development teams manage their infrastructure efficiently. You’ll assist with implementing new services and act as a consultant to our engineers, guiding them in choosing the best technologies for their projects. You’ll also ensure that our teams have the right tools and resources to build effectively, with sensible defaults and access to everything they need to succeed.

What you will do

- Design, build, and maintain high-performance, scalable, and well-documented data pipelines.

- Create automated monitoring and alerting systems to ensure data integrity and proactively identify anomalies.

- Collaborate with cross-functional teams to understand data needs and deliver data solutions that support business objectives.

- Lead the migration of data infrastructure from legacy systems, ensuring minimal disruption and optimal performance.

- Set and uphold data engineering standards, share knowledge, and promote best practices within the team.

Who you are:

- At least 5 years of experience in DevOps or related roles

- Good knowledge of maintaining Unix server infrastructures

- Experience with major cloud providers such as AWS, Google Cloud, or Azure

- Proficiency in Linux OS and the ability to code in Python

- Experience using monitoring tools like Sentry, NewRelic, Kibana, or Datadog

- Understanding and interest in the security aspects of running a cloud infrastructure

- Eagerness to automate tasks as much as possible

- Fluent spoken and written English

Nice to have:

- Coding knowledge in Golang, Python, or PHP

- Experience using a broad range of AWS technologies such as EC2, ECS, RDS, S3, CloudFormation, ElastiCache or CloudWatch

YOU ARE THE CORE OF ABOUT YOU.
We take responsibility for creating an inclusive and exceptional environment where all genders, nationalities and ethnicities feel welcomed and accepted exactly as they are. We believe that a diverse workforce essentially contributes to the ABOUT YOU culture. In order to maintain talent and diversity, we emphasize the care for physical health, mental health and overall well-being. Our values and work ethics essentially contribute to our brand mission: empower acceptance and shape an inclusive, fair and circular fashion culture.

We are looking forward to receiving your application – preferably via our online application portal! This way, we can ensure a faster process and for you, it is very easy to upload your application documents. :)
Indeed checking analytics turned the button to "save & proceed" and after unchecking, the button remained like that.
NFT bacteria?
Show HN: Convert your voice to valuable content
Convert your voice to social media posts, blogs, lists, newsletters, etc.
> Does any of these scrapers uniquely and unambiguously identify themselves as a bot?

It seems like all of them do, yeah: https://github.com/eob/isai/blob/b9060db7dc1a7789b322b8c2838...

Not sure if they're really "scrapers" though, if they're initiated by a user for a single webpage/website, more like "user-agents" in that case, unless it automatically fans out from there to get more content.
This understates civilian firearms development that was cutting edge. Notably the Thompson gun and BAR. Of course the US then kneecapped the industry with the NFA. The 1911, while being an old design lasted for many more decades as well.
Show HN: Pyro – build your own private video gallery
Pyro is a tool to build your own private video gallery. We collect videos from not just YouTube, but many other sources (e.g. Vimeo, TED, Rumble, CNN) based on the keywords that you are interested in. The videos are then presented in a familiar video gallery interface.

You can make your gallery private or public. You can let users sign up as members and receive newsletter updates. They can leave comments.

I watch a lot of startup pitch videos, so here's a Startup Pitch site I created recently.

https://video.heystartup.com

There is an option for the site admin to approve videos before they are published on the site, so you can moderate the quality.

Thanks for checking it out.
Mobile Twitter on the Blackberry (2008) how times have changed
GPL Question
so lets say i use a GPL licenced library to make some software then sell access to the software with infrastructure for a fee while never distributing it in binary nor source code form am i still obligated to to open source the software?
Indiscriminate scraping is a dick move.

But if you’re going to do it, do it properly. I would have hung it off the Like button with an ungodly ZooKeeper ensemble and trained a GBDT on which parts of which URLs I could just obliterate with Proxygen.

We’d have it all in about 4 days. Don’t ask me how I know.

The second worse thing about the AI megacorps after being evil is being staffed by people who use Cursor.

Edit: on the back of the valued feedback of a valued commenter I’d like to acknowledge that I made a sloppy mistake and have corrected in haste, making no excuses. It would be super great if the largest private institutions in history of the world took the care with give or take everything that I do with trolling on a forum.
It's disheartening to see that much parking place around that spot.
I’ve really enjoyed moving most of my reading to TTS-generated audiobooks. I haven’t tried the newer AI voices but that certainly sounds like a step up!
See also: https://en.m.wikipedia.org/wiki/West_Florida_Controversy#Con...

Turns out the answer to "Why does Alabama only have a bit of the Gulf Coast?" is a surprisingly deep and intriguing rabbit hole.
It is a kind of bug/quirk: it implies that the compiler is not buildable from scratch in its current form. It depends on a binary that knows how to translate \n.
If there’s a brain microbiome then why does nothing grow when I send CSF from an EVD?
In Smalltalk, `;` does two things: terminates the current message (EDIT: while ignoring its return value) and propagates the target object of the current message as a target for the following message.

So this:

scene add: sprite;
add: otherSprite;
setBackGround: stage;
start

is equivalent to:

scene add: sprite.
scene add: otherSprite.
scene setBackGround: stage.
scene start.

In Dart, they use `..` prefix instead of `;` postfix: https://dart.dev/language/operators#cascade-notation

var paint = Paint()
..color = Colors.black
..strokeCap = StrokeCap.round
..strokeWidth = 5.0;

You can model this with monads easily, but it's just one, very limited application of them - monads are much more general.
Writing content should not take hours, even when you are busy, you can simply record your voice and Codlixe will turn it into valuable content you can share with your audience.
Whether you want to journal, take notes, write consistently on social media, draft a YouTube video script, Codlixe can handle that for you by simply converting your audio recording to various platforms.
Ha I went on this when it was up in Scotland, it did runs around Mull from Oban I think it was, or something in that area! It was neat being able to see a lot of the engine/cranks that are exposed doing their work as you steam across the sea.
nice concept, I'm waiting for the cheap Chinese clones
> is being staffed by people who use Cursor.

Any specific reason?
Interesting, great example. This kind of compile time safety can't be achieved without borrow checker, I guess? I'm now thinking hard if there's some type magic similar to the exhaustive checks for Typescript discriminated unions ("kind satisfies never" checks in switch statements).
If you want a plasma mobile device, your best option is to find devices that are supported by PostmarketOS. That is a distro (kind of like Ubuntu etc ...), which under the hood can use libhybris to talk to Android drivers etc..

https://wiki.postmarketos.org/wiki/Devices

There maintainers create configurations for those specific devices to make them work well with postmarket OS:

https://gitlab.com/postmarketOS/pmaports/-/blob/master/devic...
An article on another species doing this: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5125654/
Some of the scrapers used by big companies do identify themselves as bots by using unique user agents. Of course, it does not mean that they don't have other bots running around without the bot user agent name.

Whether those days are over or not will greatly depend on the outcome of the ongoing New York Times vs OpenAI lawsuit. If OpenAI wins, then it pretty much green lights all the other scrappers to feast upon the web
Ask HN: What are some companies that are using AI mitigate fraud online?
Good stuff!

I'm big on accessibility support.

Web sites aren't really my deal, anymore, but I always used to make sure that my sites were very accessible, when it was my deal.
Kind of ridiculous for something that could be solved by a paper thin wrap of copper mesh around the motor.
Because these microbes are better educated?
Game rips. Straight from Final Fantasy tactics. Played this game while on the tram heading to work.
Easier because directly comparable, harder because one can't tell the difference?
I've had the opposite experience with things I already kinda know the answer to and just want to find the source. It's pretty much 50/50 if it selects a high quality source or some random website thats in the top results for whatever search query it cooks up.
>How would you solve this?

Publish it anywhere and make sure the wayback machine can index it.

https://web.archive.org
There's one four-way stop I pass regularly in Ireland [0].

I suspect there isn't enough room for a roundabout, and we also don't tend to construct roundabouts on hills (I'm not sure why they're any worse than other junctions there). There's a steep gradient going uphill from South to North.

Normally it would be a two way stop, and I sometimes wonder why that wasn't chosen here. Likely because visibility is bad (trees, walls, curves - it's worse than it looks in the satellite image) and cars coming from the east and west can't completely tell that it's safe to enter the junction.

[0] https://maps.app.goo.gl/i5pezayHLJEDPEPLA
Worn down by privacy options? Let users eat code
*bacterai
Plenty of smart people use Cursor I shouldn’t have been dismissive.

I meant people who don’t work at Cursor.
You don't need grid to get energy from the SUN.
IANAL. Normal lgpl and gpl only applies on distribution, so no.

There's an affero gpl that would apply to your case.
The key point i remember from this book is the emphasis on P (Production) and PC (Production Capability). I took this to heart and have always focused on my PC (acquiring new knowledge/skills etc. in various domains) while i am delivering on my current P (i.e. doing what the job requires). Too many people get caught up with the immediate needs of the job at hand and never look beyond it. PC requires being proactive and thus needs discipline and persistence.
Have you measured it?
You're right this was not the correct way to put it.

To be honest, much of this was influenced by Peter Singer's views, if it can help me justify myself. Here's an essay that outlines his views, and the fully rejects them: https://www.equip.org/articles/peter-singers-bold-defense-of...

I know this is a morally bankrupt view, yet something about it feels right.
8-Cores Ryzen 9000X3D on Cinebench R23
> Go try Ruby on Rails for a while!

You gave a long list of benefits of Rust - which should have answered your own question - and then suggested people use an ecosystem with almost none of those benefits.

I’m sure it made sense in your head.
I have observed this bot requesting URLs that haven’t been live for over a decade, and to which no reference can now be found in search engines. I imagine there must be a private trade in URL lists.
Offtopic: can any Greeks here give some color on the tech situation in Greece?

Is hiring (and firing?!) an english-only office possible in Greece?

Is there available talent for a typical saas dev/marketing ?
This is hugely oversimplified and doesn't really correspond to real life. Not all roundabouts are symmetric and not all have four entry-exit pairs. Many roundabouts have two lanes on some entries, but a single lane on others, similarly for exits. In scenarios like this you will inevitably have to switch lanes in some scenarios. It isn't really as big of a problem as you make it sound though, since roundabouts naturally have everyone go slow, crashes are very rare so long as the layout is clear.
What's wrong with mini-roundabouts? We've got lots of them here in the UK, mainly in residential areas and I don't see the issue with replacing a 4-way stop intersection (U.S. style) with a mini-roundabout. All that's needed is to remove the STOP signs and splash a bit of white paint onto the road to mark the mini-roundabout. Optionally, build up the mini-roundabout to make it harder to drive over.
not to mention the dozen+ other sources DuckDB supports (Iceberg, Parquet, CSV, Delata, JSON, etc.).

DuckDB extension support / dev experience is quite good now too. I've been working on some improvements (e.g. predicate pushdown) to the Iceberg extension and it's been pretty smooth.
The 6-bit byte was still common at the time. Previous DEC machines had word sizes like 12 bits, 18 bits, or 36 bits. Apparently, the PDP-11 instruction encoding mostly had field widths that are multiples of three bits (although the opcode field mostly used 4 or 7 bits), and the usable address space for the machine was 15 bits when measured in words.
One good reason to use FM instead of the internet is that it scales better - you can have practically infinte receivers, wheras most digital radio on the internet will deliver the same content for each listener individually, thus using more bandwidth per listener.
Once the header is read, you can iterate over the ReadableStream, though, can't you?
IMHO, there are three scenarios:

- Regular Web / Services: IMHO, Go, Java, .NET are better candidates there

- IoT devices with Web or API interfaces: Rust is good there. Access to I/O resources etc.

- Extreme high-performance services: Something like a DNS-over-HTTP or wall street data brokers. But for that you need a VERY solid server (but most likely not a framwework).

The regular web case will not produce a framework (out of commercial success), it is much easier to opt for a traditional languages/frameworks and hire inexpensive developers for that. The extreme high-performance services will not produce the framework you want and the likelihood is very small because the number of companies doing that is very low. Leaves the IoT space, which, IMHO, has the best chances BUT will not be the one optimized for your big server machine scenario.
Day Rates (2023)
Bacterial 'flipping' allows genes to assume different forms