skysight-inc/HackerNews huggingface dataset:
Location: Colombia, Medellín
looking for INTERNSHIP opportunities

Remote: No

Willing to relocate: Yes, actually anywhere :)

Technologies: Scala, Java, Javascript, C++. Hadoop ecosystem (Spark, MapReduce, Hive, Pig, HBase, Kafka), Akka and Functional Programming skills using the Scala programming language.

Résumé/CV: https://gist.github.com/ronaldKM98/2c1c38226de83177936c2d692...

Portfolio: https://github.com/ronaldKM98

Email: cardonamronald@gmail.com
Yes, even then. If I'm getting my information from English-publishing Shanghai think tanks then I'm just going to assume that I'm wrong.

I mean, I know how many contradictory economic opinions are generated by universities where I speak the language and have a reasonable grasp of the economic fundamentals and understand what the various interest groups want. It would be a special form of madness to assume I know anything but the most basic facts about China from a survey of internet articles.
Yeah that makes a lot of sense to compare trend lines across channels - thanks for sharing!
Discord uses Rust via Elixir/BEAM NIFs to scale to 11 million concurrent users. Big enough for you?

https://blog.discordapp.com/using-rust-to-scale-elixir-for-1...
This one? The JS is very light and optional. And this site is far more interactive than most websites.

I'm not sure why you need a modern "looking" site since JS is about the functionality not the looks.
Very strange. Early yesterday morning, I thought out of nowhere: "hey! around 2011 or so, our lounge in our organization used to have Linux Journal. Wonder what happened to that subscription?" So sad to see this happen. I personally would like this to continue, as I am sure many of my generation of programmers.
The problem with mathematical economics is that the models are incomplete, and people aren’t perfectly rational actors. Math got us into the financial crisis in 2008.
Two more thoughts:

- A slide in AMD's presentation suggested 64C would cost $7k, but that's for the top two-socket-capable version. If you "just" want 64C, not 2x64C, there is a $4.4k single-socket 64C part. Or if the RAM/PCIe capacity of two sockets is useful, you can get two 32C parts, and those start at $2k each. Makes pricing look better at 64 cores.

- Since they turned on most everything on the I/O die for all parts, seems possible to build boxes with lots of RAM and I/O but as little as 8C or 16C ($500 or $1k) of CPU. Of course, balance tends to be nice, but the ability to make it as lopsided as you want could be relevant for applications that are very RAM/IO heavy (caching), or if you're running a commercial DB where you pay by the core. Neat.
Sure, people are creatures of habit. But this isn't Yahoo vs Google we're talking about. People are going to be throwing down hundreds or thousands of dollars per CPU, and the differences are not remotely subjective.
> Traffic lights where I am require a cherry picker in the intersection to get at.

How hard is it to get a cherry picker? (Check your local tool/construction rental place) What about if you climb on top of a van, or a box truck?
> "On a journey of a hundred miles, 90 is but halfway"

The closest I could find (via googling) is this saying - "Walking 100 Miles: Stopping at 90 miles, is the same as stopping half-way" which means being 90% done with something is the same as being 50% done - you're not done!

https://www.orientaloutpost.com/shufa.php?q=walking+100+mile....
FOSS Spot 2: Manjaro Switching to FreeOffice, LibreOffice Viruses, Xfce 4.14pre3
The important thing is: Picasso knew what to study. Over time art had established a canon of things which helped people to get better at classical arts. Only after he studied that canon in depth and for a long time he could then break into new territories and start breaking rules intentionally to develop his own style/school.

Our craft is very bad at providing such a canon. It is even anti-intellectual in parts ("what do you mean you cannot be a master after x weeks? You are a gatekeeper! you suck").
That and we are still not sure what is important and what isn't (i.e. what should be part of the canon). Our medium of study changes all the time. Arts medium of study is reality and reality, for all our advances, doesn't really change.
Neat trick! I exported from GIMP and then used pngcrush. Interesting that this case isn't covered by that workflow.
Loadsharers: Funding the Load-Bearing Internet Person
> If you can't on your particular Unix, I'd actually say that your Unix is probably not letting you get full use out of your RAM.

What use is "full use" if your system live locks!? This is similar logic to that of overcommit--more "efficient" use of RAM in most cases, with the tiny, insignificant cost of your processes randomly[1] being killed?

What happens in practice is that people resort to over provisioning RAM anyhow. But even then that's no guarantee that your processes won't be OOM-killed. We're seeing precisely that in serious production environment--OOM killer shooting down processes even though there's plenty (e.g. >10%, tens of gigabytes) of unallocated memory because it can't evict the buffer cache quickly enough--where quickly enough is defined by some magic heuristics deep in the eviction code.

[1] And before you say that it's not random but can be controlled... you really have no idea of the depth of the problem. Non-strict, overcommit-dependent logic is baked deep into the Linux kernel. There are plenty of ways to wedge the kernel where it will end up shooting down the processes that are supposed to be the most protected, sometimes shooting down much of the system. In the many cases people simply reboot the server entirely rather than wait around to see what the wreckage looks like. This is 1990s Windows revisited--reboot and move along, unreliability is simply the nature of computers....
Make an AR Drawing App – Part 1
For god's sake- please speed it up. I have a kid playing AAA little league and most games go over the 2 hour limit with just 4 innings played. Soccer, Basketball, Flag Football are all 1 hour games tops and involve a lot more running, action. Baseball has 1 poor kid pitcher trying real hard to get the ball in the strike zone and most often missing, walking the batter and repeat...while all the other players (batting team and fielding team) are just watching idly and praying- 'for god's sake just throw the damn ball straight, so we can move on!'
Evinrude's E-Tec line is two-stroke and goes up to 150 horsepower in the G1 series, and to 300 horsepower in the recent G2. That's pretty substantial.

OTOH, they have done a lot of engineering to meet emissions requirements, so they are a far cry from grandpa's old outboard that left trails of blue smoke.
seems like a lot of room for competition...
I'd take a compiler backend that compiles large parts of the modern software ecosystem every day and has countless programmers using it over some niche compiler that is used only for a vanishing fraction of all applications but boasts some kind of official stamp of applicability in safety relevant contexts.
That's exactly my conclusion as well. Uber and Lyft will adjust their prices close to what taxis used to charge. Their market cap will dramatically go down until self driving reignite the price war.
> You are seriously giving authors too much credit.

Sure, how can we credit someone who did the research and prepared the paper in its publish-ready form :)

> The vast majority of the journal papers require enormous amount of production editing

Absolutely! Such as introducing new errors by people with no subject understanding. :)

> that's exactly why the EICs and societies sold those journals to publishers.

They are sold to them for the very simple reason: $$$ they get from it :)

> Graphs do not fit the page ...

If any of these are not acceptable, the journal is perfectly correct to request changes from the author. Which I as author would prefer over introducing damages by people with no idea what my papers are about.
Thank you for putting this together. It’s helpful perspective.
and patreon is down for maintenance when this article is on HN main page
Here's a pretty decent, graspable explanation: https://physics.stackexchange.com/questions/142463/does-a-ti...

Tires that are not slipping are not creating any force against the road surface (so they don't have to slip when coasting, but will slip while accelerating longitudinally [braking or accelerating fore/aft] or laterally [cornering]).
Computer Science Illustrated (2014)
Yes, much of the article is explaining why this is reasonable for a group of 2-5 and terrible for a group of 10,000, and ways to make this more manageable in non-obvious ways.
Sad to see this go; any recommendations for a good alternative available in Canada?
That is a "driver's view" of tire slip (for best results, don't spin or slide the tires too much) rather than a chassis or tire engineer's view of tire slip (if you don't slip the tires, you can't generate any force).
Using Kickfire for Competitive Intelligence
Fox $179M 'Bones' Ruling: Lying, Cheating and “Reprehensible” Studio Fraud
Except in a case when we want to build an e-commerce website for client. PHP has so many mature frameworks, like Magento/WooCommerce etc. I look at Python ecosystem. Yeah, we have Oscar and Saleor but they are pale compared to their PHP cousin.

But other than e-commerce, yes, Django or even Rails is my preferred choice.
Could you say more? Describe a possible company.
I wish OpenBSD had more unofficial documentation on this topic.

I am designing some python software application that configures custom hardware. Since the application requires specific hardware peripherals and an exotic network configuration, it makes sense to package it on a purpose-built appliance.

The software application works on any unix-like environment with python3 available, so OpenBSD and Debian are both candidates; both support my hardware platform and both receive security updates. Debian can be pared down to a minimal install to harden it, and OpenBSD has proactive security features like pledge() that could be integrated into the application code. Either way, I'm mostly looking for a not-insecure OS that can run some python code.

While OpenBSD's security is venerable, debian stands out in software packaging software. Building a .deb, signing it with a GPG key, and installing/removing it is covered by numerous tutorials. On debian, `apt-get' can install this package, and later remove every file.

But figuring out the ideal way to make an equivalent package for OpenBSD has been less straightforward. The ports tutorial says all ports need to be built with X-windows running on the build machine. Does that still apply to python3 code? What if I have a compiled utility to add to the package later? There is a man page for 'pkg_create' but there's hardly any tutorials that reference it or how to use it.

On freenode, #openbsd has been full of incredulous, unhelpful tips like "why would you use a package manager when you could just untar an archive onto root to install your application?"

As much as I respect the OpenBSD team, it's frustrating when you try to perform what should be a straightforward task but google and IRC make you feel like you're the first person who's ever tried it.
> Software is the only industry where you are asked to build systems that have never been built before but that are more complex than anything ever built in the history of "mature industries"

I have a feeling that some SpaceX engineers would have something to say about this after one of their rockets lands on a floating barge.
I dunno about some of this; working for a security company in a non-security software role gets you a lot of adjacent experience (take extra courses mandated by the company, go to extra talks, work with super smart security people), but I don't consider myself anything like an actual security expert after doing this for nearly 8 years.

There's a lot of not-security work to be done in the security industry, and it's not all work that gives you security-specific experience. I like to think I'm good at what I do, but it's not security, even though it's to help security people.
Because you're not truly out of o memory at that point. there are still pages that can be evicted.
to invoke the oomkiller sooner you have to use heuristics to determine when a request could be satisfied in theory but not practically due to page thrashing.

The oom killer only kicks in sometimes, e.g. when programs make truly egregious allocation requests.

The benefit of having swap is that it turns things into a soft degradation since it's much easier for the system to start with swapping out rarely used pages. The gradual loss of performance makes it easier for the human to intervene compared to the cliff you encounter when it starts dropping shared code pages.
HealthEngine facing multi-million-dollar fines for selling patient data
It is one of the inspirations according to someone on the project...

https://www.fastcompany.com/3063135/welcome-to-1986-inside-h...
>The real question is: why were the Europeans the only ones to embrace it.

I haven't read Huff's book so here's my stab in the dark. Europe has a lot of mainland coastline and the Mediterranean, which favors the formation of many small nation states and trans-Mediterranean trade. Among a large number of diverse and competing states, political, military and social ideas are more likely to be employed somewhere, and if successful, will rise to prominence within the local trade cluster by the process of natural selection.

If you have a large number of independent nation states, many of which import products and ideas from the far East, one of them is likely to put together a new military innovation that gives them an edge in warfare. Since the area sees frequent competition, other nations will quickly come into contact with the new technology and be forced to adopt it, or risk swift decline. A period of rapid innovation in metallurgy, chemistry and navigation (to name only a few) would develop a political culture that values technological development over traditional ideals.

I guess this would increase the demand for scientists/intellectuals and engineers. The total fund allocated by the political elite towards academics either through patronage or universities would increase the number of scientists in Europe. Ease of communication through mail channels and access to wider array of materials, both developed due to the increased volume of trade, would allow more scientists, to do more complicated research and exchange ideas more easily than ever before.
Lots of frameworks can be used as Electron replacement, including RN.
Time-Based Analytics
I know the CW is that sysadmin/devops is being automated away, and a lot of people think programming is about automating all the things (or at least as much as you can), but doesn't what you're saying prove that they aren't obsolete for large-scale providers?
Me too! It’s a great tip
The whole countryside vegetable stall blew me away when I first to Japan but now I love it. Just grab, leave the cash in the box and go. Most of the time the vegetables there aren't prime targets so stealing a bundle of spinach is probably not worth your freedom or time.

I believe the reason for it has more to do with the JA not allowing commercial sale of produce that isn't perfect and some farmers just seeing if spare change can be had. In a neighborhood next to mine some families have farm plots next to them and they sell vegetables from their drive way. It is interesting to say the least.
Ask HN: Share an Idea?
If you're like me, you often have a lot of ideas that you don't have the time or resources to execute on.
If so, why not write it down for your fellow hackers' enjoyment?

Topics can be anything: product ideas, service ideas, blog post topics, stand up comedy skits, research initiatives you wish could get funded, etc.
Because simplistic policies like this can never satisfy everyone.

On a server the process using the most memory might be the mail server so killing it is a bad idea... unless it normally never uses more than 2GB and for some reason it’s eating 14GB at the time.

You have to define quality of service, set relative priorities within those categories, be able to correlate memory usage with load to detect abnormal spikes vs normal spikes, etc. For example a daemon’s memory usage is probably correlated with its open socket count.

That in turn relies on a system much smarter than init scripts that understands the system is under memory load so re-starting a daemon that was just killed might not be appropriate (which gets into policy questions too).

For interactive use things are even more complicated; you need a mechanism for the active application being used by the user to donate its ultra-high priority to any daemons or child processes it is talking to. If image_convert is running because I initiated it as the user then it should get more memory (and CPU/IO). If it is running because my desktop window manager is refreshing it’s icon cache then it should get its priority smashed hard - if the system is under pressure or burning battery it should even be killed and prevented from restarting temporarily. Who is going to do all the work in the kernel, userspace libraries, then get all the apps to properly tag their threads and requests with the correct priority?

tl;dr: setting policy is hard and anyway it becomes the herding cats problem.
The Earth is finite, as is the time until the Sun will swallow it, so "it's finite" it true about literally every resource.

It seems more a way to fuel depressions than a useful way to analyze anything.
I had hoped Apple News+ would be a way to access and compensate all the great small niche magazines like the stuff you see in Casa Magazines in Manhattan. Instead it was the most generic stuff that's in every supermarket check out line. I know they have to appeal to a broad range of people, but you'd think Apple would appreciate all those music, art, and culture magazines. Maybe there was no easy way to include them, but for a company with that many resources they should have found a way.
I've got an electric chainsaw (Kobalt 40v).

Pros : quiet, clean, light, ultra-reliable

Cons : weak. Not good for cutting up medium-to-large trees. Only good for softwood under 9", hardwood under 4"

I don't do much serious treefelling these days so I prefer it. And if I need a Husqvarna 350 or whatever I borrow it.
Why is modern web development so complicated? Because of fucking JavaScript and shitty front-end frameworks. The end.
That's not true!

I don't usually write proofs at work but I do work with formal models of critical sections in our systems.

Although on the side I am working on bootstrapping Lean's ecosystem so we can write more proof-carrying code in more places.
Okay okay okay, check this out. (Yes global mean ocean temperatures are rising, but at least in the USA, climate change appears to be making the country have milder weather)

> New York City has not had a daily high temperature above 100 degrees since 2012, and it has had only five such days since 2002. However, in a previous 18-year span from 1984 through 2001, New York City had nine days at 100 degrees or higher. When the power went out in New York City earlier this month, the temperature didn't even get to 100 degrees - it was 95, which is not extreme. For comparison, there were 12 days at 95 degrees or higher in 1999 alone.

> Kansas City, Missouri, for example, experienced an average of 18.7 days a year at 100 degrees or higher during the 1930s, compared to just 5.5 a year over the last 10 years. And over the last 30 years, Kansas City has averaged only 4.8 days a year at 100 degrees or higher, which is only one-quarter of the frequency of days at 100 degrees or higher in the 1930s.

> Here is a fact rarely, if ever, mentioned: 26 of the 50 states set their all-time high temperature records during the 1930s that still stand (some have since been tied). And an additional 11 state all-time high temperature records were set before 1930 and only two states have all-time record high temperatures that were set in the 21st century (South Dakota and South Carolina).

> So 37 of the 50 states have an all-time high temperature record not exceeded for more than 75 years. Given these numbers and the decreased frequency of days of 100 degrees or higher, it cannot be said that either the frequency or magnitude of heat waves is more common today.

Source: https://m.accuweather.com/en/weather-blogs/realimpactofweath...

Like seriously, what are we predicting again?
In almost 40 years, there were two breaking changes from 9X to NT family, from XP to Vista.

Two. Linux? Who's counting anyway.
Maybe Epic will get in on it
Spotting Schizophrenia Symptoms
This was the case 30 years ago when publishing was expensive.
Today this should be a button click in a fully automated system.

Which is not to say, societies don't benefit from the system -- they actually get a lot of $$ from it. The sad part is, they only get a small part from the much bigger $$$ going to publishers.
> The oom killer only kicks in sometimes, e.g. when programs make truly egregious allocation requests.

This is a myth. Allocation failures happen at least as much on small allocations as on big ones. In fact, I see OOMs every day and the vast majority of the time the trigger was a small allocation. For example, the kernel trying and failing to allocate a socket buffer.

And that's really the root of the issue. You have a giant application with a 200GB committed working memory set doing important, critical work; and it gets shot down because some other process just tried to initiate an HTTP request. It's a ludicrous situation. And people defending Linux here by saying the same problem exists everywhere else are wishful apologists--the situation is absolutely not the same everywhere else.

Even setting aside the issue of strict memory accounting--which, BTW, both Windows and Solaris are perfectly capable of doing, and do by default--Linux could still do dramatically better. Clearly there's some level of unreliability people are willing to put up with for the benefits of efficiency, but Linux blew past that equilibrium long ago.
Being unable to run those sorts of experiments doesn't disqualify a field from being a Science - consider astrophysics.

I think the issue here is more that economics is describing human behaviour, and we don't fit well in to a mathematical formula.
Fast Websites Are Good for the World
Not cheap, for the rich - https://www.jakarta-apartment.net/category/apartment/cosmo-p...

Don't know why the article has no pics with cars in it since all the townhouses have car parks.

Interesting to know what the PM 2.5 is.
You can disable the oom killer if you think its heuristics are misfiring.

> OOM killer shooting down processes even though there's plenty (e.g. >10%, tens of gigabytes) of unallocated memory because it can't evict the buffer cache quickly enough

Is that due to dirty pages? Have you tried tweaking the dirty ratio to get dirty files flushed sooner? I believe there were also some improvements in the default behavior towards the end of the 4.x series that are supposed to result in more steady flushing.
this isn't open source, it's media. I am/was a LJ subscriber, sad to see it go, but I don't feel starved of similar material.
I hear you. But they aren’t going to turn around and become the publisher we want, that is a fantasy. They have no incentive to change.

It isn’t easy for academia to help itself (for once), but it is the only viable solution imho.
Yeah, this is ridiculous. A real red team does not involve engineers testing their own code. The fact that they couldn't break it means nothing.
Communism.

Any society with majority chinese population (singapore, taiwan, hong kong) that has a free market is a modern developed country. China stuck behind for 50 years, and is now catching up.