skysight-inc/HackerNews huggingface dataset:
I'm trying to do some estimates using the AWS Pricing calculator.

You can't go with a single instance and a ton of EBS storage, because it caps out at 16TB of disk, and 19Gbit[0] of EBS bandwidth, even on an instance with 100Gbit networking.

So, depending on how you can allocate storage, you're probably going to need some kind of clustered filesystem like GlusterFS

It's also not clear how well the application can spread it's writes - if it's all focussed on writing one file at a time, we need the most throughput to a single node at a time.

Storage:

Option 1: "GlusterFS: Hope it spreads writes"
20x c5n.9xlarge (36x vcpu/96GB RAM/50Gbit NIC / 9.5Gbit EBS) + 16TB st1 HDD storage each
= $43k

Option 2: "GlusterFS: more EBS IO"
20x c5n.9xlarge (72x vcpu/192GB RAM/100Gbit NIC / 19Gbit EBS) + 16TB gp2 SSD storage each
= $89k

Option 3: "GlusterFS: hey local storage is faster/cheaper"
6x i3en.24xlarge (96x vcpu/768GB RAM/100Gbit NIC/ no EBS)
= $47k

I was wondering about insane ideas like using mdadm in RAID0 over NFS Mounts presented by (say) 281 t3.2xlarge instances each with 1x 1TB EBS volume. That comes out at around 62k for the storage instances.

Compute:
I don't know how important CPU vs Disk IO bandwidth is.
The instance the author is using has 4x 15 cores (60 cores total).
The most I can get with standard EC2 instances is 64 cores, but that has 25Gbit network, and the next down from that is 48 cores.

1x i3en.24xlarge (96x vcpu/768GB RAM/100Gbit NIC/ no EBS)
= $7.9k

There are bare metal instances with more cores/memory and up to 100Gbit networking[1], but I can't find any pricing on them.

All up, I think $51-55k/month using standard instances would probaably do the job.

[0] There are the bare metal instances mentioned in the link below that get up to 28Gbit EBS per instance, but again no details on pricing.

[1] https://aws.amazon.com/blogs/aws/ec2-high-memory-update-new-...
Compiled list of #KnowYourWorth reports on Twitter
What's with the autoplaying video and prompt for notifications? Annoying.
Along these lines there is the ZX Spectrum Next which just started shipping their pre-orders:
https://www.specnext.com/

Also the Playdate which is ARM based and will have an SDK supporting C and Lua:
https://play.date/

Then of course there’s tonnes of older hardware that’s well emulated and well understood. I’d recommend the GBA as giving all the flavour but having a reasonable amount of headroom.
> This is the thought that should be in your head. The real conversation needs to be constructive.

Agreed on that. If your manager isn't doing his/her job, or just wants quick outs of 1:1s, that conversation needs to be had instead of the status quo

On training, I have seen companies where it just takes a few months for a new hire to get anything done. Silo-ed institutional knowledge, spaghetti codebases, too much emphasis on processes and meetings, no proper new-hire onboarding, etc. Those are usually red flags. But yes, I wouldn't expect a new hire to be completely as productive as a seasoned employee even after a few months, but should be enough to get going.
Even if your goals to progress or change what you are doing are limited do not assume the environment around you will stay the same.
Nothing to apologize for. Try finding an example of sense 1. The dictionary you want to cite doesn't provide one.

By inspection, there are exactly zero such examples in the first 200 COCA hits for "myriad", of which there are about 4000 total.

There are 72 total hits for "myriads", of which exactly one is arguably using the sense of 10,000, but it is a translation of the foreign phrase 八百万の神, where 万 is literally 10,000. I don't know whether the number in the Japanese phrase is meant to be interpreted literally, but I doubt it. Even here, the translation given is "myriads of gods", not "eight hundred myriads of gods".

You don't seem to understand what linguistic prescriptivism means. Everyone agrees that there are rules determining what is and isn't valid in a language. Descriptivism is the approach of determining the rules from usage. Prescriptivism is the approach of postulating an authoritative source.

Descriptively, "myriad" cannot be used to indicate the quantity 10,000 in English, only to indicate a large but vague number.
Interesting, thanks for getting back :)

I worked for a couple of years in medical imaging (on a RIS) and our customers were very Radiologist focussed for everything except head scans (where the neurologists also read the scans).

I would hope to see AI-based assist technology hitting the market in the next 3-5 years for X-Ray/CT. Something in the form of the different rendering modes that you can use in a viewer. It's hard to tell though because the whole field is driven by hardware not software. Software seems to be an afterthought. The software seems more focussed on lock-in (integration, meh).

I had a vision for a future where the doctor in a hospital could push an image out to the "cloud" of teleworking radiologists, with the image being read in real time. It would be like load-balancing all of the work over the entire world. Technically it's tractable but the combination of privacy issues, the aforementioned hardware-driven market and the state of Hospital IT is what makes it impossible. Well that and the scaling problem (you need a critical mass of top-quality teleradiologists on your side to do it).
I always found the even versions (D4,D6) buggy while D5 and D7 were very reliable.

D4 had bugs in its COM code. In 2000 I worked at a Dotcom (homedirectory.com) and we used a D4 COM search component running in SQL Server 6.5. It used to crash when the CPU load went above 5%. I guessed it was D4, recompiled under D5 and that fixed it.

Microsoft as part of its settlement to Borland over the employee poaching (including AH) provided technical info that let D5 generate reliable COM code.
Being rich has nothing to do with intelligence. It is a matter of luck, luck to be born in the right family, in the right country, at the right time, luck to have the right connections, and luck to have a lot of starting capital.
Typically, that means storing two digits in a byte (halves storage size compared to a text string), 9 in each 32 bits (gains another 11%), 19 in each 64 bits (gains another 5%), or something similar (at this scale, I would guess it uses at least the ‘19 digits in each 64 bits’)

Idea is to not use “one digit per byte”, but to keep addressing individual digits cheap.

”I thought they were incompressible like random.”

They’re easily compressed, if you accept taking this program and it’s configuration file as a compressed version.

(And yes, the output of a pseudo-random number generator compresses extremely well, too)
Thanks

I do a lot of web work - especially converting from wireframe to code for design departments without internal developers, sorry I should have mentioned that.
Well that's one piece of software I'm never going to use. I can't even browse their site without creating an account. I presume I also need an account in order to use the software. No thanks.
* Last LTS release before Qt 6
The article is about South Korea government PCs.
So all the startup founders wanting to succeed will now to eclectic and interesting things on saturdays.
Google seems to build things their engineers want to build.
Amazon seems to build things their customers want to have.
Actually games improve very specialized cognitive functions. For instance you know that being good at chess doesn't relate much to being good at poker, and being good at tennis doesn't do much for your football abilities.

Similarly, being good at some FPS game makes you at best marginally better at video games of a different genre, and have no actual relationship to your abilities in the real world. Even a study on driving games showed no improvement of actual driving in test subjects.
There is a PKI: DNSSEC with SSHFP records.
I have many cron jobs in AWS Lambda functions for many tasks.

I wrote a blog post about how to monitor a competitor website using Python / Lambda and serverless framework for deployment: https://dzone.com/articles/monitor-your-competitors-with-aws...

For lots of workflows we also use No-code/Low-code tools like Zapier / Integromat.
>> You'd be surprised how many papers get submitted to ICML/Neurips that don't use PyTorch or TensorFlow at all

I do keep up with literature and I do some applied research as well, so yeah, I see such things from time to time. The volume of papers is so intense though that unless there are other redeeming qualities if the paper does not use frameworks I already know (TF and PyTorch), I ignore it entirely. I wouldn't say I missed much that could help me in practice. One exception is Leslie Smith's work on cyclic learning rates and momentum modulation - he did it on some ridiculous setup, but it works for what I do.

I'm more surprised how many papers are written for tiny little datasets that you'd never use in practice, especially optimization papers. I mean, come on guys, I get it it's fast to train on CIFAR or fashion MNIST, but those results rarely translate to anything practical. And some papers are just plain not reproducible at all.

>> Google researchers are never going to use PyTorch en masse

IMO they should. It would easily double their productivity, and if Karpathy is to be believed their skin and eyesight would improve too: https://twitter.com/karpathy/status/868178954032513024?lang=...

>> I'd place my bets on Jax

As an ex-Googler, I'd place my bets in something else TBH. Google projects that aren't critical to Google's bottom line tend to deteriorate over time. Just look at TF. I'm not cruel enough to suggest it to my clients anymore, even though I could charge twice as much (because it would take twice as long to get the same result).
Yep, best thing about Apollo!
It's a quite common way to negotiate lower licenses fees.
In other words, this will generate pointless traffic - unless your system has strictly unidirectional flows at any given time, you have doubled the problem in an attempt to eliminate it (plus incidentally doubled the energy consumption, which translates to cost).
Interesting. What are the tricks?
I jut begun to do some partial automation of website interaction with the extension Tampermonkey for Google Chrome to inject my own scripts on certain websites, often creating an additional control panel UI for custom actions such as scraping or data input. I use Tampermonkey in such a way that the code managed by Tampermonkey are only loading scripts that load my actual scripts from GitHub and other sources, such that I always get the latest published versions of my scripts.
Streetlights in Berlin (at least on my street) are completely autonomous. It's a lot of fun to watch them start sequentially (with the light dimming down).
This is certainly true, but it strikes me that the solution must be a move towards simpler primitives so that managing a cloud-based piece of software doesn't require so many moving parts.
It's a 10 based system after the first 1'000. Hardly a "redeeming" feature considering numbers are always read/parsed right to left (Arabic) and given the first three digits separated for the thousands, the mind is already "trained" for the expected regular expression to parse. Booby trapped!

1 crore = 1,00,00,000 (written with accepted formatting). Which is 10'000'000 (formatted) - 10 million - for the rest of the world. Anyone used to the Western formatting will quickly get cockeyed seeing those numbers at a glance. I'd imagine it is just as jarring for the Indians seeing Western formats.

https://en.wikipedia.org/wiki/Indian_numbering_system
Perhaps underappreciated aspect of automation is friction reduction. Having a semi-automated process can be what it takes for you to stop avoiding doing some little chore, or what makes you no longer suffer as you do it.
The minigame aspect doesn't really matter -- most games can be considered a bunch of minigames wrapped up, where each component is really its own subgame (eg weapon crafting vs fighting vs town-building vs etc), all threaded together to produce some overarching value.

The problem with spore is that it had a very clear, and obvious, and intentional thread -- the evolution of your creature. Each minigame was supposed to impact the way your creature developed -- the constraints of your environment, your skill, your choices, etc, were supposed to guide your creature down a path such that your choices from minigame 1 would change what you'd have to work with by minigame 3.

The problem was that nothing mattered. It wasn't that there was no unifying vision -- it was that the game pretended everything mattered, but you'd chug along and realize there was literally nothing affected by anything you did -- the whole thing was an empty shell.

It was supposed to be a (perhaps goofy) cross-millenia simulation, and instead it was.. 5 fairly worthless games mashed together to produce one large worthless game.

The crime too is that mario party knows their minigames are shallow -- so they last for at most minutes, and offer like 60 of them. Spore, of course, somehow believed it had some kind of depth, and run you through each minigame for hours.
Huge idea requiring massive Capex seems more like an amazon thing (AWS, fulfillment centers, etc) than a google thing.
The Euston - St Pancras thing is OK if you're commuting for work distance wise - it's just adding 15 mins to your journey when it should be 30 seconds.

For travellers who don't know London, who have to lug around baggage and small children it's a massive pain.

It's well worth the effort to connect it. It would already be way better even if you had to switch train in one station.
Probably because he had his own share of abuse as a kid:

“From 1929, when he was 13, Dahl attended Repton School in Derbyshire. Dahl disliked the hazing and described an environment of ritual cruelty and status domination, with younger boys having to act as personal servants for older boys, frequently subject to terrible beatings. His biographer Donald Sturrock described these violent experiences in Dahl's early life. Dahl expresses some of these darker experiences in his writings, which is also marked by his hatred of cruelty and corporal punishment.”

https://en.m.wikipedia.org/wiki/Roald_Dahl
I had once surveyed algorithms and libraries that implement accurate and reasonably efficient mathematical operations. The status quo is a bit of mess.

- For many transcendental functions, 1 ulp error bound is reasonable but not necessarily reproducible, and 0.5 ulp (optimal) error bound algorithm exists but is significantly slower, to the point that Kahan [1] has once pointed out that some versions of MATLAB hard-coded log10(10^n) cases to give a false illusion of accuracy.

- The optimal algorithm is, fortunately, computationally tractable. Many functions have been thoroughly analyzed for the closest outputs to IEEE 754 binary64 values and therefore the number of bits required to accurately round them, and that number of bits is small enough (~150 bits) that all trig/log/exp/pow functions can be computed without bignums.

- For a long time CRlibm from INRIA was the only library implementing optimal algorithms, and it was licensed in GPL. A successor to CRlibm, Metalibm, was in development with no licensing statements available, but nowadays a version of Metalibm [2] is licensed in MIT so you can probably make use of them.

- If I recall correctly, CRlibm had way too big code footprint (several hundreds of KBs when compiled) that I couldn't really use that anyway. The main culprit seems to be five sets of functions for each possible rounding mode. I haven't checked yet if a new Metalibm is still big.

- There are many approximation algorithms and libraries if you don't want the full accuracy. One notable example is Sleef [3] that has multiple functions for desired accuracy (from 0.5001 ulp to 3.5 ulp). Assuming that we will eventually have a set of small and portable libms necessary, I believe a variation of Sleef's approach is desirable for future programming languages: a (compile-time) argument for accuracy, all the way from the optimal (0.5 ulp) to the crude (2^20 ulp?).

[1] https://people.eecs.berkeley.edu/~wkahan/LOG10HAF.TXT

[2] https://github.com/kalray/metalibm

[3] https://sleef.org/purec.xhtml
Bingo. I've seen this strategy time and time again.

It's part of the reason Microsoft is playing to their strength with Office 365, it's almost impossible to replace at this point.
Australia has it pretty hard be competitive exporting industrial goods since the supply chain is mostly overseas and the domestic market is small, which means most things will gehave to be exported again. All this results in high shipping costs and latency in addition to being a high wage country.
What is the threat model? Do the organisers have an incentive to cheat? Do invitees have one?

If the organisers can be trusted then the solution is to have a device displaying a QR code that rotates regularly (30 seconds?) at the location and have attendees scan it.

If the invitees can be trusted then the process can be reversed. Each invitee displays an unique QR code during check-in the organiser should scan.

If neither can be trusted then you’d need a neutral third-party to act as a witness by scanning both the organiser’s code and the invitees’. This proves that the witness was at the event (and it was indeed open to the public) and that invitees did show up.

Out of curiosity, how do you prevent a malicious party from creating dozens of fake accounts and using them to check in at their fake event?
Trains are privatized in the UK. Maybe this project is being built with public money but it will eventually be privatized.
(pastiche: I had to look it up)

pastiche

n 1: a musical composition consisting of a series of songs or other musical pieces from various sources [syn: medley, potpourri, pastiche]

2: a work of art that imitates the style of some previous work

http://www.dict.org/bin/Dict?Form=Dict2&Database=*&Query=pas...
I use telegram, ifttt, Google sheets to calculate expenses.

At my last job, I used Zapier & Zoho CRM to automate creating leads from email requests which saved me hours of time.
what is economical output relevant? why is that an indicator of change :) just compare what you spend your daily life doing and thinking, to what your parents did and think, then go to another generation, then another
The 2010s Killed the Cult of the Tech Founder. Great!
Hurting Android is embedding unremovable Google services all over the place and implementing bullshit defaults like auto turning your wifi on and collecting + storing all available networks silently. Pretty sure they are intentionally slowing down old Pixels as well.

/rant
Some more items that I've setup in AHK:

- Launching commonly used apps, like Notepad, Windows Explorer or Sublime Text

- Launching commonly used websites in a browser, e.g. gmail

- Paste from the clipboard into a language translation site (languageX to languageY via URL parameters)

- Open a to do list in Excel (hard coded file path)

- Text expansion for personal and work email addresses

- With one keypress, open the train schedule on the website, type in the 'from' and 'to' stations, search

- Text expand to symbols that I always forget, eg. euro symbol, hash sign etc

- Google/Wikipedia search clipboard text
Ask HN: Why do you use gRPC?
Hi there, the organisation I work for is betting heavily on gRPC. We did a few things on it, learned some, won a few battles and lost some.

The general take is that people are somewhat unsure if it's the right way to go.

We like the "developing by contract" aspect when using protocol buffers but we don't like the workflow as much.

I'm interested in hearing stories from people who have used successfully (maintaining a production product) and unsuccessfully (back to rest or whatever you were doing before.

Thanks
would be interested to see why you use tampermonkey instead of GreaseMonkey. I tried both but stuck to GreaseMonkey as it was open source.
I learnt Pascal at Uni in the late 1970s and programmed in Turbo Pascal from 1986 on and then Delphi D2 since 1997. Slightly off-topic but two of my applications written in Turbo Pascal:Warlord and Quest, in the period 1988-1990 are still in use today. Both are postal games now run on the internet by kjcgames.com.

I'm currently maintaining and extending a major proptech application with 1.3 million loc of Delphi (XE7). Not so long ago the firm bought another firm with its own a 1.3 million loc of D7 code! There's still a lot of Delphi code about.
If at some point a nationally important company wishes to pivot or at least threaten to pivot on some important tech, their statements will carry less weight unless they've already been developing the tech with some visible gusto. I think there is some strategic value to holding something like Bing, assuming its costs are reasonable.
@netsharc, the class booking opens every day at 10:00PM and everybody knows that. :)
Some Hand-picked Jobs From Hacker News and some top VC funded Startups
Jobs on Hacker News are listed at random, thus requiring that you apply to them in several random ways. We've structured this process, making it easier to apply with just a few mouse clicks. Make use of some of the winning cover letter samples, modify to suit the need.

https://www.myunigram.com/job
If you travel regularly, Tripit is a great service for organizing your flights and hotels on to your calendar (Google Calendar also does this with Gmail but it doesn’t work reliably, especially if you book some of your travel via your personal email account). You can set up a free Tripit account and either forward your receipts to it or let it look into your email for them automatically. Add the calendar of your Tripit trips to your work Google Calendar. These now show up in as a second calendar but are not visible to your co-workers. Create a free Zapier account and use a Zap to automatically copy all events from your Tripit calendar to your work calendar, which your colleagues can see. If you want to be shown as available while traveling, you need to change the multi-day event that Tripit creates from busy to available. And if you change your flights, you need to manually delete the old ones. But, people will no longer book you into meetings when you're on a plane.

Zap: https://zapier.com/apps/google-calendar/integrations/google-...
Show HN: Combining DeOldify and EDVR
HTTPS: //wellnesscarepills.com/the-huge-male-secret/
The Huge Male Secret
the main factor you get with the guide is the list of twenty-two ingredients and herbs that Kevin determined have the most effect in terms of growing penis size. the good news is which you don’t need to live at the equator to get them, as they could all be discovered at your nearby grocery store. every ingredient is a effective growth-stimulant in itself, but whilst they're combined simply right – something you’ll find out about as you examine via the manual – you’ll get the expansion you’ve constantly wanted. large Male mystery is set greater than just the length of your penis though. You’ll additionally see an increase in girth and usual circumference.
https://wellnesscarepills.com/the-huge-male-secret/
https://www.youtube.com/watch?v=IwrnGoZgYiY&feature=youtu.be