skysight-inc/HackerNews huggingface dataset:
First you worry about meeting your paying customers need. Then you spin up just enough infrastructure to handle effectively meeting the need to continue getting paid.

You can do that with some shell scripts on an instance and an e-mail service and manually copy the whole mess for backup if it makes sense. The how of implementation is very case specific.

Thinking more on it I'd sum up as "provide a service that doesn't require that you be Google". If you start by specifying an impossible amount of infrastructure maybe there's an issue with management :).
It's an internal issue also; Microsoft employees/contractors/partners all need to log in to their account to get work done.
I'm aware of Smith's discussion of specialization of labor from an economic perspective but not from a social one, where can I read more about this?
I think this is going to be a pretty contrary comment, let's see how this goes.

I don't know what everyone is doing with kubernetes that takes up so much time and effort, especially in a SME environment.

I'm currently operating three separate kubernetes clusters for three different clients. And this is just me, there are no other tech people involved day-to-day. These clusters require minimal maintenance, just the occasional upgrade.

These clusters are small (1-10 nodes), and are on either GKE or bare metal. The biggest is around 100-200 running pods. I have a CI/CD pipeline setup in GitHub actions for each client. Development & CI uses docker-compose.

I used to do the old-hat 'scp your code to the server' kind of deployment, and this was a lot more pain. Kubernetes is big, but it solves so many problems. Ensuring everything is actually running, networking, SSL certs, persistence, configuration, etc etc.

I've been running this setup for 3+ years now. If I cast my mind back, I think I spent a weekend reading the k8s docs concepts section, then pretty quickly deployed a cluster on GKE. Given it was a team of one, I ditched RBAC which removed some complexity. Getting the CI/CD pipeline setup took some time (maybe a few more days), and I built more tooling as a went.

I really think kubernetes can be really useful for tiny teams, but there is a lot in there that is aimed at big teams. Use the bare minimum possible at first, and grow from there.

---

Now here is a bonus unsolicited contrary comment.

Deploying k8s used to really require a cloud provider, particularly for persistent volumes and load balancing. But I think that has changed over the last few years. OpenEBS and MetalLB look like they are really addressing this.

Also, has anyone noticed that dedicated servers are cheap as chips now? I think the equivalent dedicated server would cost around 10x as much as an AWS instance. (I'm looking at Hetzner in particular, but OVH isn't far behind)

Given what is currently available from the k8s ecosystem, there seems to be a really strong case for deploying on bare metal these days.

For example, at a ballpark you can get a 400GB+/40core cluster for around $300/month (which also includes another 80GB/10cores of ancillary gubbins). The cost for that easily comes in at around $3,000 on AWS (ex any storage).

OpenEBS gives you replicated storage, MetalLB gives you your load balancing, and each instance has a couple of terabytes of NVMe too. And, if you're worried about reliability of physical servers, at that price you could replicate your setup across datacenters at minimal cost.

---

I should add a caveat here. I've been working freelance in tech for 15 years and I am a massive generalist. I do everything from business consulting to design, devops to development, and I also run an ISP so know my way around networking/BGP etc. That being said, setting up a quick cluster on GKE doesn't require many of those skills.

Having written this ambling comment I guess I'll also say that I am am available if anyone wants a cluster setting up. I'm also about to start providing managed k8s services.
I use VS Code's native integration with WSL. So VS Code runs as a native Windows app with nearly everything you'd expect, but the actual files being read/saved are inside WSL. Works great with Vagrant, Docker for Desktop, Git etc.
That's creating a new type B. In contrast, interfaces can have their definition spread across multiple code units.

interface X {
x(): void;
}

interface X {
y(): void;
}

class Y implements X {
x(): void {
console.log("hello");
}

y(): void {
console.log("world");
}
}

const z = new Y();
z.x();
z.y();

This is important for keeping up with API changes in browsers that may happen faster than the DefinitelyTyped project can keep up.
You're absolutely right. It slipped my mind as I considered it more of a language-agnostic tool, and I organized the article as the provisioning of tools for all popular programming languages. That said, I added it to the post as a language-agnostic tool - thanks for the pointer!
In my experience, if you can't say "get over it" to your customers when they complain about performance then Lambda is not the right tool. Just use EC2.
My last company tried really hard to pitch AR/VR projects. Using headsets, phones even the Bose sunglasses. It was a huge struggle to find anything compelling to do with AR even when it worked. We ended up selling a few nifty marketing experiences and artsy installations but they were like 30 second experiences and not useful for anything. The tech "works", it's just not very compelling.

Think about phone AR which works very smoothly and Apple/Google have been investing in hardware upgrades to enhance AR experiences yet it's been 5 years since Pokemon Go and no one has figured out another interesting thing to do with it.
Ironically, by putting in less effort at work. I know this sounds awful and a lot of PMs would probably gasp at hearing this, but I started to exert myself less at work -- worried less about code reviews, stopped stressing over small mistakes, accepted that I'm not producing the highest quality code, stopped trying to go the 110% to impress my peers and higher-ups. Really, I stopped caring as much. Choosing software engineering as your profession carries with it the high probability that it will ruin your hobby of programming.

I found that I was able to refocus most of that energy to when I'm off work and can actually get my creative juices flowing on projects I care about and have control over.
I've been wondering if all the companies who lost out could sue for compensation. Doctrines like detrimental reliance seem to come into play here. Is anything happening on that front?
I prefer Gitlab CI for solo projects, it's super convenient.
Just create .gitlab-ci.yml file, attach runners on my pc, laptops and go.

Deploy with scp/sftp.

Also it's very useful to have DEV.md file for each repo. It helps to remember how to build and deploy your project. Documentation for future me :)
Ask HN: Faking a Developer Interview
I received an email below about pretending to be another developer which sounded interesting.

"Our team members live in the U.S, but originally from Europe. All of us are talented and experienced developers. But they don’t have a native English speaking level. So we have a big bottleneck during the interview with the clients for their projects.. We need someone to talk natively in English instead of our members. I want you to help me.

Your Role:
So your role is to do the call with clients by using our team member's name, their skills, and experiences. This is not a representative position. You should "pretend" like him during the interview only.

You will have 3~5 interviews with different clients every day and normally each interview will take 30~60 minutes. Of course, we will send all information for you to refer to before the call. You can refer to it before and during the call.
You will need to record the interview, we will compensate for your service based on interview hours.

We are already working with some collaborators in the same position, but we need 1 person more.
Please feel free to message me if you are interested in this role."

Has anyone had experience with fake interviewees/new hires? I wonder how widespread this problem is.
Lessons on ML Platforms – From Netflix, DoorDash, Spotify, and More
That’s a much better phrasing.
Borgbase. I'm not affiliated with them, I'm just a happy customer
That's what we did, put a proxy in front that caches everything. Now that Docker Desktop requires licensing, we're going down the road of getting everyone under a paid account.

I'm sure Rancher is great for personal desktop use, but there's no reason large companies can't pay for Docker.
Go package for running Linux distributed shell commands via SSH
because that is not true

how much of that data is flawed because of inflated prices in California?

75k a year in NY

https://www.glassdoor.com/Salaries/new-york-city-computer-pr...
IIRC a few 737MAXs fell out of the sky. Clearly there being nothing wrong with the purpose nor concept of MCAS wasn't sufficient to keep the airplane from crashing.
Show HN: Advanced search tool for Amazon (exclude third party seller, etc.)
I'm not sure I understand your question, but I will try.

>>Why do you need to have 600W to power a graphics card?

You don't. There is no GPU currently that needs that much. But as cards are comfortably approaching 400W and more, a new connector is necessary so you don't end up with GPUs taking 3 or 4 existing PCIe 8-pin power connectors. This single 55-amp compatible connector allows for significantly easier routing of paths on circuit boards.

>>Why do they need an independent power connector?

Because the PCIe slot alone can only provide 75W of power. And if it could provide more you'd need to provide that power to the motherboard so you just moved your connector from one place to another.
Bookmarked, looks interesting. I'm curious if you ran into cases where limiting yourself to just coreutils made things odd. Text processing without awk, for me, would be hard. Cut is janky about leading spaces, for example...it sticks to a pure delimiter mantra.
AWS Lambda is pretty cool, it just gets used a lot for applications that it was never really designed for. While I wish that Amazon would address the cold start times, if you try to grill your burgers with a cordless drill, you can’t really blame the drill manufacturer when the meat doesn’t cook.
Communication issues aside, good luck finding developers who aquired all the necessary skills to work in software development without this mindset.

Of course it would be great for a company to be able to hire people who only learn new things on weekends and then 100% commit to and derive all their motivation from delivering the product, but I think that's quite rare...
For the VSCode situation, there is a Remote extension by Microsoft for editing files that live on the WSL2 side.

For everything else you can just use the network mount to WSL2. So the performance hit will be on the editor I/O side but not the application runtime.
I've experienced this as well. I gave up on optimizing it.

I get around it by using a load balancer (Cloudflare currently) that does periodic health checks. Keeps it alive and the charges are minimal (still well within the free tier).

Speaking of Cloudflare it's on my "nice to-do" list to move this to Workers as a primary anyway.

I also use a completely separate uptime monitor and alerting platform (Uptime Robot) so one way or another I'd be keeping at least one instance warm no matter what.
This only tells us that it’s primarily Europeans taking part in the conversation.
Since all the people in this thread do some kind of personal hosting/DevOps, I am posting one of my recent comments on how to make the security of your infrastructure rock solid:

> I self-host three VPNs to protect my infrastructure heavy startup https://quantale.io

I am a big fan of Pritunl which is opensource and provides network security with a lot of ease. I am in no way affiliated with them, I am just a big fan of Pritunl. I use Pritunl to limit access to servers and web applications for my different teams. For each user, you can generate a profile and assign the servers and port they have access to on the server. For eg:

- Only dev team can access ssh port(22) on stage server and not open to internet.

- Any one in the team can access stage version(port 443) for testing purpose.(Not open to internet)

- Only I can access all ports on all Prod servers(only 443 open to public)

What hackers can't see, they can't attack. Especially the port 22 on your servers should only be accessible to you and not the internet.

I self-host one instance each of OpenVPN and Wireguard with Pi-Hole which is then used to access my Pritunl Server adding extra layer of security.

Each of these 3 servers can be hosted on Hetzner $2/month instance. With a mere $6, you can add an extra layer of security to your infrastructure. Pritunl itself also provides subscription so that is also an option.

https://news.ycombinator.com/item?id=28671753

If you want to discuss more about this or security in general, feel free to reach out to me on my email on profile.
I've sort of been dealing with this at my day job, except it doesn't come from other developers, it comes from management.

Every few years, a new Head of Engineering comes in and says something like "let's use $TECHNOLOGY for this project" with the expectation that it will make the company more effective, I think. It's been GraphQL, microservices, clouds ("can we do this with Lambdas on AWS?" when we don't have any other significant infrastructure on AWS), and a bunch of other things.

On one hand, it's good for me to dabble in a lot of this stuff (learning the basics of GraphQL on company time helps my resume, after all), but I end up pushing back most of the time ("I don't think this is a great use-case for GraphQL. From what I understand, $X and $Y would be reasons to use it, but for this project, REST makes more sense because of $Z"). Meanwhile I'm just trying to get my work done and not make it a hassle.

If we had a good reason to use GraphQL (or any of the other things management suggests), I'd be into it, but I don't want to be wrestling with fitting square pegs into round holes for no benefit.
I became a FAANG Staff Engineer in 5 years. These are the 14 lessons I learned
Am I reading the conclusion correctly that people who were infected with some strain of COVID and received two doses of the vaccine fared better against future variants than people who only received the vaccine?
DataStation, open-source data IDE, 0.2.0 is released
You are being downvoted but this sentiment is not wrong. See also the nordic countries and this Freakonomics podcast that goes into some detail: https://freakonomics.com/podcast/happiness/ In particular, note Denmark's notoriously strict immigration system.

The key point being that ethnically homogenous societies tend to work well. It isn't guaranteed but it does contribute because everyone is the same or similar. Similar ideals, similar goals and so on. The feeling one gets in these societies is stifling. We have nice things but they are for us, not for you.
This is another example of AWS over marketing Lambda. Lambda is horrendously expensive when requests pass a certain level per second. You can graph it against ECS / EC2 to see the point it stops becoming economical.

Taking all of this into account, Lambda is then useful for a very small niche:

- Tasks that don't care about low P99 latency. These tend to be asynchronous processing workflows, as APIs in the customer request path tend to care about low P99 latency.

- Tasks that have a low request per second. Again, these tend to be asynchronous processing workflows.

You talk to anyone on the AWS serverless team and the conversation eventually focuses on toil. If you can quantify engineering toil for your organization, and give it a number, the point at which Lambda stops being economical shifts right, but it doesn't change the overall shape of the graph.
I had a Pixel. That it took a screenshot when I switched apps makes sense. It allows the task switcher to open immediately and show the most recent state of all my apps. A screenshot of some sort is mandatory for the OCR functionality that allowed me to select text from these tiles in the task switcher (super handy!).

I’m now on iOS 15 on an iPhone 12 Pro Max. I think I’ve seen movement on the tiles in its task switcher, so I’m not clear if it takes screenshots. But the fact that the task switcher opens with no delay suggests that screenshots might be used?

I’m only defending taking screenshots. Transmitting them to other parties is problematic.
I recall reading how there are people in the world who conflate Facebook with The Internet. The only Internet they experience is through Facebook. They have have no idea about what is outside Facebook's garden.
Pros: They have probably close to 0 tech debt. It's amazing. There's some overengineering, though. Pay seems pretty good. Workload is reasonable, no heroism. Lots of training. Sexy test and debug suites. Schedules are actually slightly more accurate than usual, risk is managed well, but it's still software. There are some relaxing roles where you need to do nothing and still get paid well. They appear to overhire.

Cons: No heroism. They have coding down to factory like precision. 996 is a meme elsewhere but it strongly applies here. Seat warming seems to matter more than output. There are good people there, but well, such environments don't attract the competitive.

CCP involvement is probably similar to FAANG and the FBI/US military.

Also you can verify a lot of information on Glassdoor, instead of listening to strangers who have never worked there. Anecdotal information is anecdotal.
I'd recommend anyone interested in the NTK and its limitations to check out Greg Yang's work [1] and the recent book by Roberts, Yaida, and Hanin [2]. There's clearly a lot more work to be done on neural network scaling limits; the NTK is overly simplistic (though useful).

1: https://www.microsoft.com/en-us/research/people/gregyang/

2: https://arxiv.org/abs/2106.10165
4 Habits of Fast Learners
Hi!

I'm one of those consumers who use Amazon frequently, and I was getting tired of seeing products with fake reviews and fake ratings sold by third party sellers, and of having to set filters every time I did an advanced search.

I'm not a programmer or an app developer by profession, but to solve these frustrations, I've created an app that allows you to exclude third-party sellers from Amazon's search results and specify other search criteria, and I'd like you to try it out.

The main features of this app are as follows;

- You can do an advanced search from Amazon using four different search filters (Seller, Sort, Price, and Discount).

- Search result will be displayed by using your browser. WebView is not used in this app for secure internet access.

- You can save your favorite search conditions as the default settings, freeing you from the hassle of setting the search conditions one by one.

- Available in seven languages, and compatible with Amazon in almost all countries/regions.

I would really appreciate if you could give me some feedback on this app, whether it is about its features, usability, technical issues, quality of translation, or anything else.
But you can create models with the code. And then take those models you created and use them commercially. So I don't see a problem.
Is NYT part of a COVID coverup?
Seems to me this multicore journey was quite a barn burner; might as well have gone all the way to linear types as your GC.
I don't see the irony. If you're pro-mandate, you'll support mandates and oppose bans on mandates. It seems perfectly consistent to me.
Is there much mystery?

SGD in a small number of dimensions is easy enough to understand, and as Hinton said in an online class I took years ago: to visualize very high numbers in dimensions, close your eyes and shout out the number. He was joking but his comment convinced me to disregard the concept of millions of billions of dimensions and instead concentrate on practical techniques that enable training many layers, architectures that are multi-headed, etc., and use model architectures that are known to work for different types of problems.
I doubt we've hit peak, but there are important things to consider.

If we run out of energy before we exit our gravity well, that's one instance of the great filter. Resource conflicts might also trigger war that could destabilize society and prevent us from advancing.

The world needs energy, yet many of us pay far less attention than we should.
Cloud optimization startup Cast AI raises $10M
First, you can't learn anything, you don't have the time, the energy, nor the talent.

Second, it's inefficient. You should leverage humanity experience.

Third, you can learn a lot faster if you start by repeating something without understanding it. Even maths.

So yes, understanding is useful, but doing without understanding is not bad. It's just a tool.
Believe me, tech support is actual work. Without it, all those writers and accountants wouldn't get much done.

The CUA interface is perfectly efficient and works very well. It doesn't need a mouse, although you can use one if it's there.

As I said: I was a skilled user of a bunch of the leading pre-CUA DOS apps, and I can navigate a CUA interface using hotkeys very quickly and efficiently without a pointing device. Occasionally, over the years, astounded onlookers have asked how it's possible that I can operate Windows so quickly. The answer is that I don't use the mouse much, and the reason is that in my first job, my employers didn't own a PC mouse. They sold Macs; if you wanted to do graphical pointy-clicky stuff, you bought a Mac.

I decided that Windows looked like it was useful and could be big one day, so I installed Windows 2.01 and learned to use it... without a mouse. The same keystrokes mostly still work today, from obvious ones like Ctrl+S to save, Ctrl+X/C/V for Cut/Copy/Paste, to less-known ones like Ctrl-W for Close Window and Alt-F4 for Close Program. Alt-Space for the window control menu, then X to maXimise, etc.

It's a common but spurious argument to claim that because one knows one particular program well and can operate it very quickly, that this fact in some way indicates that the program's UI is particularly efficient or well-designed or something. It isn't. It just means that that individual knows it well.

The basic concepts of the desktop GUI were nicknamed WIMP: Windows, Icons, Menus, Pointer. Well, each of those works fine in isolation. Icons are a useful abstraction all on their own; for instance, iOS and Android make very extensive use of the "I" part without the "W," "M" or "P".

By the same token, the W and M parts -- windows and menus -- work very well without a GUI. It's very handy that the same keystrokes that let me drive Geany or Mousepad or Notepad also work fine in Tilde or MS-DOS Edit.

They're no less efficient. Ctrl+S Ctrl-W to Save then Close is just as quick as ^KS ^KD, or !wq, or C-s C-x, or Shift+F3, Ctrl+F4.

But what's a huge boon to my or anyone's efficiency is that once I've learned Ctrl+S, say, it works in thousands of programs on multiple OSes. C-s C-x or Shift-F3 don't work in anything except the one particular app they were designed for.

This is not a difficult or obscure principle.

Proprietary UI = bad. Open shared UI = good. :-)