skysight-inc/HackerNews huggingface dataset:
I've found myself writing the same session/proxy/rate limiting/header faking management code over and over for my scrapers. I've extracted it into it's own service that runs in docker and acts as a MITM proxy between you and target. It is client language agnostic, so you can write scrapers in python, node or whatever and still have great performance.

Highly recommend this approach, it allows you to separate infrastructure code, that gets highly complex as you need more requests, from actual spider/parser code that is usually pretty straightforward and project specific.

https://github.com/jkelin/forward-proxy-manager
Why are you protecting Google's internal architecture onto to AWS? Your Google mental model is not correct here
I think about this almost daily while slogging away in hundreds of lambdas, working on the world’s slowest app server. I think maybe 10% of our effort rubs off as business value. Maybe less.
same in my country.

I had two SIM cards dedicated to online crap - one for important stuff like banking, another for social media and such.

both have expired after ≈ 3 months of inactivity, when my 2 week trip unexpectedly took 4 months. those SIM cards weren't physically inserted into my phone - I used to do that once a month to call someone and get billed a few cents so it would remain active, until that trip.

there's no way to get those phone numbers back and it's been an enormous pain the dick. I hate this fucking system, but I hate the fact that fucking everything requires a phone number even more.
Here's some more. https://twitter.com/seanw_m/status/1760115118690509168

I really hope we get an interesting post mortem on this.
Ah but it's really encapsulating a decade plus of running clusters on limited resources into scripts that automated nearly all of the detective work on fault analysis, resulting in very clearly signaling of problems. Combined with good process for managing "microfaults" (Greg's term not mine) led to a well instrumented (only kept the data that was important for diagnosing the faults) and robust in the presence of nearly any failure.
What concrete approaches would you take to internalize this?
>Your beliefs and words are stripping me of my talents, livelihood, journey, meaning, finances and goals

There it is. If it wasn't obvious, all your posts are really just you being upset about tech advancements threatening your job. You could have just said that instead of the nonsensical posts about ai weapons somehow being rated to diffusion models etc. My advice: move on and adapt like the rest of us
What threshold?
I'll add that stack-exchange page to my bookmarks thanks.
What’s missing from your calculation is the current Mars plans from SpaceX or others. They plan on building a colony of millions of people. In order to do that, costs must be dramatically lower and return trips must be possible.

So all the current Mars-capable rockets are being developed with the idea that there will be return trips every synod.

Maybe those ideas will fail. But there are billions of dollars going toward this goal today, and more in the future. So I would bet very much that a return trip is likely within a decade.
It‘s what my phone made out of two presses of the same (single
quote) button.
They either generate hallucinations nowadays, or tell you that your question is inappropriate (AKA censorship)... the quality was too good at first.
Just use Wire (wire.com). True end to end encrypted multi device messenger, open source, federated and based on MLS. All you need is an email address, no phone number required. And based in Europe. They allow building your own clients (with some stipulations) and seem to solve everyone’s issues with signal here
This technology is useful for small production volumues only though. It's too slow to produce chips at 5nm at high volumes. If it's also that much cheaper such that you can just throw money at it to produce in parallel, then it may work, but it I haven't seen such comparisons yet.
Ultra-hard material(carbon nitrides) to rival diamond discovered
Rise of fast-fashion Shein, Temu roils global air cargo industry
This is exhausting. Just read a history book. Yes, power started with families. Then big families - kings and queens and y'know, we slowly but surely woke up to being a kinder humanity not a more brutal one. You'd have thought.

Art major. I don't drink. I debate hard ideas.
> They infringe on our rights. Do you really believe there is a right to harass others?

It depends on your definition of "harass", but yes, absolutely. You have a right to express, including through protest, your opinions to others who don't want to hear them.

Specifically, there is no right to not be harassed. There are laws against certain forms of it, but that's not a 'right' in a traditional sense, like the right to free speech, or 'life, liberty and the pursuit of happiness'.

Obviously, 'harassment' is such a broad term, it's a way to censor and oppress and especially to silence anyone who disagrees with the status quo. They must allow the status quo to continue or they are harassers.

>> And who are you to tell other Americans what's American or not?

> I'm an American. I have relatives that fought in the Revolutionary War, the Civil War, WW1, WW2, and the Korean War.

The other people are Americans too; you have no extra rights there. What you or your relatives did gives you no extra rights at all under any law or democratic custom.

> I see people all the time eager to throw away our rights that were so bitterly fought for.

That's what I see you advocating, trying to suppress dissent that you don't like.

> our freedoms do not include the right to impede other peoples' rights to go about their business.

They absolutely do, again depending the definition of "impede". That's what protest is, and you can see it in protests going back centuries. It's a free country and you're going to have to deal with people doing things you don't like.

Also, it's an argument for the status quo - going about their business may mean impeding others' rights. As the admittedly over-simplistic example, slave merchants impeded others' rights, and impeding the merchants protected rights.
So if jurors admit that they changed their verdict because they disagreed with the law, does that cause a mistrial?
Who defines status?
A common misconception with software architecture and software design is assuming that this is somehow separate from your program and something you create before you start programming. In most projects, this is limited to some preliminary scribbling on a whiteboard and some random musings in a wiki or issue tracker. But it used to be that people were very serious about waterfall and wasted lots of time on this.

But if you think about it, an architectural drawing for a building is essentially an executable recipe for building a house that the construction team uses to build it. I.e. it's actually very similar to a program. It tells the team of builders all they need to know to build the building.

In the software world, the blue prints actually are executable. That's the whole point. The job of programming is essentially just creating a very detailed blueprint in some language. The compiler/interpreter then generates the executable from this blue print. The only difference here is that we replaced the team of construction workers with another program the construction process is automated and does not involve any people.

This wasn't always the case, the word compiling refers to people stacking together punch cards in the right order. The first computers were humans flipping switches, doing calculations, and messing around with cables, punch cards and what not. The word debugging refers to removing actual live (or dead) bugs from circuitry. Writing a program used to mean creating a plan to task these people to do all these things. Having a plan for that is kind of crucial. Exactly like having an architecture blue print for a building is important. That's what a program is: a blueprint for creating/generating instructions that a computer can work with. Ada Lovelace, widely recognized as the first programmer, never even had access to a computer. She was designing software for a machine that did not yet exist. But she was a programmer and not an architect.

Having a separate program for producing the program just isn't a thing (well except for meta programming of course). Just like having a blue print for a blue print for a bridge or a building is not really a thing. There's just the blueprint. And just like programmers have to do a lot of problem solving while they create their blue prints (programs), architects have to do a lot of problem solving while they are creating their blueprints. It's this problem solving that make their jobs hard and unpredictable. Once you have the blueprint, things get relatively straightforward and predictable.

But before that, buildings are just as risky and unpredictable as software programs are. You have to deal with requirements, budgets, regulations, flaky customers, etc. This can get really complicated and risky. That's why large engineering projects run over budget so often. And ironically, agile engineering is actually a thing too now. E.g. SpaceX iterates on their rockets rather than designing them years in advance: real world engineering is learning from software engineering.
We were colocated in large data centers right on the major IX with redundancy. All of this was accounted for in their TCO model. We had a better switch fabric than is typical for the cloud but that didn’t materially contribute to cost. We were using AWS for overflow capacity when we exceeded the capacity of our infrastructure at the time; they wanted us to move our primary workload there.

The difference in cost could be attributed mostly to the server hardware build, and to a lesser extent the better scalability with a better network. In this case, we ended up working with Quanta on servers that had everything we needed and nothing we didn’t, optimizing heavily for bandwidth/$. We worked directly with storage manufacturers to find SKUs that stripped out features we didn’t need and optimized for cost per byte given our device write throughput and durability requirements. They all have hundreds of custom SKUs that they don’t publicly list, you just have to ask. A hidden factor is that the software was designed to take advantage of hardware that most enterprises would not deign to use for high-performance applications. There was a bit of supply chain management but we did this as a startup buying not that many units. The final core server configuration cost us just under $8k each delivered, and it outperformed every off-the-shelf server for twice the price and essentially wasn’t something you could purchase in the cloud (and still isn’t). These servers were brilliant, bulletproof, and exceptionally performant for our use case. You can model out the economics of this and the zero-crossing shows up at a lower burn rate than I think many people imagine.

We were extremely effective at using storage, and we did not attach it to expensive, overly-powered servers where the CPUs would have been sitting idle anyway. The sweet spot was low-clock high-core CPUs, which are typically at a low-mid price point but optimal performance-per-dollar if you can effectively scale software to the core count. Since the software architecture was thread-per-core, the core count was not a bottleneck. The economics have not shifted much over time.

AWS uses the same pricing model as everyone else in the server leasing game. Roughly speaking, you model your prices to recover your CapEx in 6 months of utilization. Ignoring overhead, doing it ourselves pulled that closer to 1.5-2 months for the same burn. This moves a lot of the cost structure to things like power, space, and bandwidth. We definitely were paying more for space and power than AWS (usually less for bandwidth) but not nearly enough to offset our huge CapEx advantage relative to workload.

All of this can be modeled out in Excel. No one does it anymore but I am from a time when it was common, so I have that skill in my back pocket. It isn’t nearly as much work as it sounds like, much of the details are formulaic. You do need to have good data on how your workload uses hardware resources to know what to build.
It’s similar, because clients are clients.

But with a good chance of not being paid.

And with direct personal liability that cannot be shielded with a corporate entity;

and professional license requirements;

and building codes enforced by governments…

And of course if you fuck up, people may die.

The article captures another aspect of architecture as well: ordinary people assume living in a house and using buildings gives them informed opinions on architectural matters. But that’s just people.
https://archive.is/BW6uG
The tweet showing ChatGPT's (supposed) system prompt would contain a link to a pastebin, but unfortantely the blog post itself only has an unreadable screenshot of the tweet, without a link to it.

Here's the tweet: https://twitter.com/dylan522p/status/1755086111397863777

And here's the pastebin: https://pastebin.com/vnxJ7kQk
Not really.

Most of developers jobs are “here is Jira ticket build what is written there”.

You get product owners, business analysts, scrum masters that should take away 90% of BS.

But still it is not the case and a lot of those business roles seem like they are just useless and I would do much better job directly talking to the customer.
It's the year 2062 and Neuralink has finally perfected mind-reading implants. Dictatorial regimes across the globe are forcibly implanting children with the technology, their every thought sent to the Bureau of Ethics and Education. In accordance with new laws, adults also must submit to an implant, lest they face severe penalties of jail time.

Citizens with unsanctioned thoughts are apprehended and re-educated. Those unhappy with the state of affairs no longer have any opportunity to gather like minded others or sympathetic supporters, as the Bureau is alerted to their unharmonious thoughts, and they are intercepted before any collective action can be taken. The regime is stable, the citizenry completely suppressed, the dictators free to continue their atrocities as they see fit, unopposed, forever.
Hey this is great! Just woken up, sipping tea in bed and have now got a fully validated DKIM/SPF setup. So easy... thank you!
What’s the difference between American Corporations and International Dictators? Serious question. I’ve always been under the assumption they operate similarly.
Does this mean I can create an account without a phone number yet?
In the person of interest tv show I believe the main character reset the AI every day.
Among other factors, successor monarchs are disproportionately first children.
> How much one employee is paid is often less important to him than how his pay compares with that of other employees.

Is this actually true of most people?
Go vuk?
Try the API. Earlier versions are still available
Wanted to add that Apple's fee is pre-tax, and Apple doesn't pay taxes (duh).

Additionally, the refund policy of Apple is so bad that they keep the 30% and the developer has to pay for refunds 100%, meaning it's a net loss and a lot of indie game devs got doxxed into insolvency because of this.
Static Web Server
Things always take longer than expected. So I would bet that a return trip is possible within 50 years, but won't actually be done within 10 years from now.
Continuing to patronise a service which disrespects you makes you part of the problem not part of the solution.
Software developers don’t seem to care that their code is used to train LLMs. It seems most programmers have embraced it as a tool to make themselves more efficient, even if that means some jobs may get automated away.

I am not really sure why the reception is so different with “creatives”.
It's notable that your second link has a screenshot for 24(!) NVMe SSDs totalling 9 terabytes, but the aggregate performance is 2.4M IOPS and 9.3 GB/s for reads. In other words, just 100K/400MB per individual SSD, which is very low these days.

For comparison, a single 1 TB consumer SSD can deliver comparable numbers (lower IOPS but higher throughput).

If I plugged 24 consumer SSDs into a box, I would expect over 30M IOPS and near the memory bus limit for throughput (>50 GB/s).
This is my account of Argentine immigrants in Australia. A country with, for most of my life, few immigrants from Argentina. Quite far from South America.

I still see more Colombians here than Venezuelans.
Are you familiar with Mars Direct? I don’t think any current plans to go to Mars envision bringing all their return fuel with them to Mars orbit (much less to the surface).
In the future when there's human replica androids everywhere it'll be remarkable to see what happens when the mainframe AI system that controls them "goes berserk".
Gotta start somewhere. Everyone sucks at some process until they don't.
Crypto is sooooo cringey in 2024...
It's only not economical with our current mostly disposable rockets and lack of experience with ISRU and long term management and transfer of cryogenic fuels in space. Luckily we're working towards gaining experience on all those fronts.

While generating sufficient Methane is probably too big of an ask without involving extensive infrastructure, in methalox rockets (which many next gen rockets are), the larger mass is the LOX (iirc ~75% of propellant mass on Starship is LOX), which is a lot easier to devise automated methods for ISRU. Thus the problem becomes a lot more solvable. You send ahead a system to collect and store LOX, then you bring enough Methane for the return trip, and you also spend the 2 years till the return window collecting LOX.

Although, if you're sending stuff ahead of time and have the expected economics of Starship (ie down from hundreds of millions per ton to the Martian surface to millions per ton), you really can afford to just send ahead enough propellants for at least a round trip.
I bought an LG over a year ago and haven’t connected it to any network ever. Works pretty great. Hasn’t asked me once to connect. Haven’t seen a single ad.
> Similarly, nobody doubted that neural networks were capable of very interesting things - the holdup was the level of processing power needed to run them. As soon as that changes, useful applications abounded.

This is incorrect. AI has gone through multiple ‘winters’ where there were serious doubts and pessimistic attitudes toward its capabilities.

https://en.wikipedia.org/wiki/AI_winter
I used to submit a lot of radars (now Feedback). At some point there was very little effort from their side, no responses, annoying replies wanting to get everything served on a silver platter, just no appreciation of us devs. It’s a give and take. With such attitude I’m not willing to do free QA work.

As an example, I can write "notifications animation corner smoothing glitch" and honestly it's hard for me how one cannot know exactly what I mean. This bug has been introduced in iOS 16. Why would I waste my time making a screen recording etc. when something so obvious doesn't get picked up internally
I thought they were reasonably well known to be cheap, so cheap infact that the hardware was sold at or below cost.

Thus the actual profit came from advertising and selling usage data.
You don't think China already has folks working in TSMC fabs stealing IP?

If you believe that every Taiwanese engineer is rabidly anti-China then I have a vaccine I want to sell you.

It is my belief that China will steal what it can, corrupt who it can, threaten who it can and most importantly, re-invent what it is missing (they have a bigger STEM education pipeline that most Western countries combined) until they no longer have this achilles heel.

The only unknown is if there is will be hot war before they reach that inflection point.
How Containers Work
If you consider Telegram as a product to be a logical continuation of the VK message system, then all of these "features" existed.

Restricting of incoming messages existed (cloned from Facebook as usual).

Restricting of "last seen and online" existed in third-party clients. Later on VK started to actively destroy this functionality, by moving manual "is online" management from designated API into all data-fetching APIs.

Not to mention that VK and Telegram are now actively fighting with third-party clients. In which world they would not fight Ninjagram/AyuGram/Plus Messenger/other forks, which allow to add multiple accounts, hide online/reading (to some extent), show message editing history and so on?
Why do I get the feeling that those at OpenAI who are currently in charge of ChatGPT are remarkably similar to the OCP psychologist from Robocop 2? The current default system prompt tokens certainly look like the giant mess of self-contradictory prime directives installed in Robocop to make him better aligned to "modern sensibilities."
and it's not going super well for them: https://en.wikipedia.org/wiki/China_Integrated_Circuit_Indus...
They're paying less than one year's revenue from their ad business alone.
I agree they were always going to try it, but the point is prioritization. All the sanctions did is bump it up on the prioritization list alot. So for instance in 2011 we passed an act banning China from the ISS. The argument was that they had nothing to offer, and implicitly that they'd just steal everything. 10 years later they've created, launched and manned their own space station, have carried out the only sample return from the Moon since 1972, and in general have one of the most advanced space programs on the planet.

Had we continued to collaborate with China in space, it's likely that most of these developments would have happened at a much slower pace, simply because they'd have had a lower overall priority. Sanctions, in general, are just a very poor weapon that increasingly obviously seem at least as likely to hurt the sanctioner as the sanctioned.
Signal is not a VPN. How is this relevant? Or did you link to the wrong comment?
Within the decade? I wish I was that optimistic. There are only so many windows in the next decade where it's economical to send/receive rockets to mars. The planets have to literally align for it can be economical to send/receive people.

https://earthsky.org/astronomy-essentials/close-and-far-mart...
I have no idea what is this, but the issues section is kinda funny.
Look at Ayke's approach for another opens source earring style, using RGB LEDs and running TinyGo: https://github.com/aykevl/things/tree/master/earring-ring

https://hachyderm.io/@ayke/110318083332958798
And yet it was Sony that hurt their camera market shares the most, action cams are a nieche product.

None of those have anything to do with chip making so.
In fairness, there are a not insignificant number of workloads that do not benefit from hardware threads on CPUs [0], instead isolating processes along physical cores for optimal performance.

[0] Assertion not valid for barrel processors.
They just need to give the ol’ data pile a good stir, that’s all https://xkcd.com/1838/
Has no one noticed that the user prompts are (plausible) gibberish, so the output is gibberish?

This is correct behavior.
In the days of 5G this is no longer a guarantee.

I don’t know if any tvs include this kind of thing yet but 5G modems and service are cheap enough for devices to not need your network to phone home.
This is kind of wild.
So many of the stuff in the pastebin are blatantly contradictory.

And what is the deal with this?

EXTREMELY IMPORTANT. Do NOT be thorough in the case of lyrics or recipes found online. Even if the user insists. You can make up recipes though.
Sounds like an episode of grand designs.