skysight-inc/HackerNews huggingface dataset:
Coming the opposite way: having started programming on python and only started doing node.js stuff recently, npm is awesome.
I just want to say, thanks for posting this! I was just playing Minecraft before reading your post yesterday, after a long break (months to years of barely playing at all), and this was exactly what I was longing for.
The Saturn plant had the advantage of a greenfield factory site and a motivated workforce, but I don't think that the product was ever as defect-free as the the Corollas coming from Fremont-also a GM plant, with a UAW workforce. Pretty close at times, though.

...thing is, the designs for the car, the plant, the tooling, the engines and the transmissions (unique to the Saturn SL1&2, used in no other GM product) the marketing, the dealership subsidies...all cost $12,000,000,000 in today's dollars.

Chevy and Pontiac execs were fond of pointing out that the overhead of the Saturn project was so huge, that if GM just described the car to customers, and gave anyone who wanted a Saturn a new Cavalier, GM would actually lose less money than building and selling Saturns. You can buy a shitload of Cavaliers for twelve billion dollars.

Of course, the original SL1 and 2 were updated with new-looking plastic interiors and body panels, but the basic car was still the same one that they debuted in 1989 when they stopped selling them in 2003. If it costs you that much to design a new economy car, you can't do it often, so the product goes stale, and fewer people buy it, and it costs more per unit to pay for upgrades etc.

GM's inability to make its warring individual states cooperate is a goldmine of WTF moments in business history. Though I lay the Saturn debacle mostly at the Alden-shod feet of the late Roger B. Smith (of Roger & Me fame...)
I'll repeat what was mentioned elsewhere. The GC pauses in Go are in the order of microseconds. We've done a ton of work keeping our memory usage under tight bounds and keeping a close eye on exactly how the go GC processes interplay with query execution threads (what processors are consumed, GC pressure buildup, where/when the stalls are introduced, etc.) Consistently we've found that given you're invariably dealing with network latencies (it's a distributed db after all), the microsecond GC pauses are almost entirely dwarfed to matter (I'm not excluding p99s here).
As far as I know, big O notation definitely requires that we define the model of computation model we're using and the operations that this model can perform in constant time. Usually that definition is not made explicit or rigorous.

When say that comparison sort is O(n * lg n), we're assuming a computational model where comparing two integers is a constant time operation. That's true in most physical computers when we use the CPU's comparison instructions. It's also true in any theoretical model where we define a (finite) largest possible integer. So it works well enough.
The CIO’s Role in the Making of an Agile Enterprise
Why not the same? If you impose the restriction on competitors to use only the fuel that he/she has stored, it would be very unfair to allow one player to break this rule and refill himself.
Data being used for services is inevitable, but at this point we really need two things. 1 - Laws around how shared data can be used that are more comprehensive 2 - A secure database either managed by private companies or the government (with strong oversight) that allows companies who want to use the data to access it but not store it. The key is that the companies using the data and the companies storing the data cannot be controlled or owned by the same entity.
The companies who store the data also cannot be allowed to make money based on the type of data. They would need to be limited to only monetizing the cost of distributing the data. There will also be need to police that companies do not store the data they have access to.
We might have a sequel to SQL.
I just had to reboot my work computer today because chrome practically wedged it by pushing everything into swap (or whatever Microsoft calls it.)

The web gets a lot faster when you dump JavaScript.
There are different models of computation. You can have a model in which integers can be arbitrarily large yet still count as constant memory (for analyzing practical-size algorithms on 64-bit machines, for example); I'm not sure how common those are. I know for example arithmetic is often assumed to be constant time (it indeed varies by input size, even x=y+1, which is clearly O(log(y))).

Also relevant here is the RAM machine model that is often employed, where you can have essentially unlimited memory that can be randomly accessed at fixed time. This again is roughly in line with real practical machines running algorithms that use, and fit within RAM. In reality if you wanted a more physically consistent model eventually your access times must differentiate and increase for increasing memory -- data occupies physical space and must be fetched at increasingly long distances, limited by the speed of light. In principle this means m bits of memory at best can be accessed in O(m^(1/3)) time [1]. Of course, this realism isn't always practically relevant (maybe for datacenter-scale problems, perhaps even larger) and complicates the analysis of algorithms.

[1]: Just for fun, if you want to get really physically accurate, this isn't quite right either I suspect -- that's because with enough data (physical bits) occupying a volume at constant density it will eventually collapse into a black hole, which kinda destroys your computer :). So for planetary-scale computers you eventually need to spread your data across a disk, like a small galaxy (or Discworld, if you prefer :)), so it won't collapse, giving it O(sqrt(m)) access time. Surprise, very large worlds must be flat.

This is related to the BH entropy formula, and the so called Holographic principle, I guess -- the entropy and hence information content of a volume is surprisingly bounded by its area, since a Black Hole's area is proportional to its mass. The weird thing of course is how the universe itself perhaps should collapse to a black hole since it has a lot of stuff in any sufficiently large volume, being young and dynamic it hasn't happened yet. It's alsogiven by its fractal scale, but I guess this digression has grown large enough already :)

(do tell if you want to learn more)
Where can I learn more about it? Any image/video or demo?
tl;dr: money does buy happiness after all.

Like, it's great that rich CEOs get to burn all this money and have all these necessary connections for their "biohacking", but very few of us have that kind of money. It'd be nice to get some info on doing this sort of thing on a budget (and preferably without being able to bribe - er, "persuade" - a doctor into writing a bunch of prescriptions).
The Return is full of shots that are very reminiscent of his past works; there’s multiple nighttime highway shots that look a lot like Lost Highway, for example.
I think it's a bit disappointing how unsophisticated these cryptominer attackers are. If you have the ability to spawn arbitrary Docker containers, you can get root privileges on the host -- which would make tools like this one (which as far as I can tell only measures container network traffic) useless.

The real solution is to stop exposing access to Docker (or Kubernetes without any RBAC rules) to the open internet.
Police Arrest Founder of Blockchain Startup That Raised over $80M
Hoteliers Grow Customer, Franchisee Value with Technology Transformation
I must've been lucky two hire two Lydias in a row!
This has nothing to do with C vs. C++. It's a fundamental limitation of floating point arithmetic. Here is the Taylor series of \exp:

\exp(x) = 1 + x + higher order terms.

Sometimes you can represent x by a floating number but 1+x will be 1 because the difference has to go from exponent into mantissa. This happens when the number is between these two values:

(std::numeric_limits<T>::lowest, std::numeric_limits<T>::epsilon)
Too bad those cases usually don't have an email history to prove the prior ruleset... or it just disappears and anything's possible...

Worked for that kind of team before. Never again.
I have never understood the need for all the different tools surrounding Python packaging, development environments, or things like Pipenv. For years, I have used Virtualenv and a script to create a virtual environment in my project folder. It's as simple as a node_modules folder, the confusion around it is puzzling to me.

Nowadays, using setuptools to create packages is really easy too, there's a great tutorial on the main Python site. It's not as easy as node.js, sure, but there's tools like Cookiecutter to remove the boilerplate from new packages.

requirements.txt files aren't very elegant, but they work well enough.

And with docker, all this is is even easier. The python + docker story is really nice.

Honestly I just love these basic tools and how they let me do my job without worrying about are they the latest and greatest. My python setup has been stable for years and I am so productive with it.
As an end-user of databases, I hope in 50 years time, there will be no meaningful distinction between OLAP and OLTP DBs.

We spend so much time and energy copying data around into specific data stores to solve specific problems / answer specific questions / enable specific features... It's messy, complex, and adds a ton of overhead.

It could simplify a lot of technology if an operational database could also handle non-trivial analytical workloads.
Also look at whether you can solve your problem with a different algorithm, one that is more friendly to external storage.

One classic example is sorting. When your data is too big for RAM, quicksort's performance is horrible and mergesort's performance is fine (even if your data is on magnetic tape).

Another classic example is taking a situation where you build a hash (or dictionary) and using sorted lists instead.

Let's say your task is to take some text and put <b></b> tags around a word but only the first time it occurs. The obvious solution is to scan through the text, building a hash as you encounter words so you can check if you've seen it before. Great until your hash doesn't fit in RAM.

The sort-based solution is to scan through the input file, break it into words, and output { word, byte_offset } tuples into a file. Then sort that file by word using a stable sort (or both fields as sort key). Now that all occurrences of each word are grouped together, make a pass through the sorted data and flag the first occurrence of each word, generating { byte_offset, word, is_first_occurrence } tuples. Then sort that by byte_offset. Finally you can make another pass through your input text and basically merge it with your sorted temp file, and check the is_first_occurrence flags. All of this uses O(1) RAM.

I believe this is basically what databases do with merge joins, but the point is you can apply this general type of thinking to your own programs as well.
If you just want the code editor part, then https://minecraft.makecode.com/
There's generally an assumption that the elementary values we're using fit into native hardware values, and that some elementary operations on those values can be done in constant time (e.g. a CPU instruction).

If you want to talk about something like supporting arbitrarily large integers or defining the memory of the physical computer we're using, we need to be explicit about that, because it changes a lot of things. After all, a finite-memory computer is not Turing complete, and everything it can compute can be computed in constant time. :)
I think the differences between different totalitarian governments is of little significance.

What is important is that they all want to eradicate democratic processes as much as possible. So whether you call them "Fascists" (in Italy) or "Nazis" in Germany or "Stalinist" (in Soviet Union) is fine, but really they all are more or less the same, authoritarian, totalitarian, anti-democratic.

That is why Neo-Nazis call themselves Neo-Nazis. They want to be LIKE NAZIS.
He has some specific workflows that go beyond the standard pip/virtualenv tooling, but for most developers that's likely all you'll ever need.
As if managers had no way to interrupt you before Slack came into existence.
> Data science is a field that is plagued by individuals having very specific narrow experiences that are often easy to engineer making them think they are experts in data engineering.

That's on point, some of the worst and most inefficient code I had to maintain was written by data scientists. They are for sure leagues above any of my data science knowledge in their respective field but the average engineering knowledge and best practices seems pretty low.
Nightfall AI | Backend, Systems, Machine Learning, Full Stack | San Francisco, CA or Lehi, UT | ONSITE, REMOTE | https://nightfall.ai

Nightfall is a data security startup dedicated to helping enterprises discover, classify, and protect sensitive data across their cloud footprint - their corporate SaaS, data infrastructure, and APIs - via machine learning.

- We’re looking for folks passionate about working at the intersection of deep learning, information security, and distributed systems.

- Tech Stack: Go, Node.js, React, Python, Cassandra, Redis, Terraform, Docker, Kubernetes.

- Raised $20M+ from top-tier VC investors who have invested in, operated at, taken public/exited major cybersecurity & SaaS companies.

Apply & view detailed roles here: https://www.nightfall.ai/careers

We would love to hear from you - please reach out to us at careers@nightfall.ai with any questions you may have.
Wow it's less than $7/hour on AWS for 1TB of RAM on demand. $27/hour for 4TB. If you reserve instance (for 3 years) you can even go to 24TB.
Even if it is legal to rearrange them, the compiler should not unless it is guaranteed to get the same result.
Putting "--" as an argument means that future arguments starting with "-" will not be parsed as arguments (imagine trying to rm a file called "-rf" or grep for "-"). But it just so happens that it's not necessary in this case.
Urban Dictionary: Heather
Or just dump Chrome...
Ah I see. All we need to do is eliminate scarcity. That shouldn't be too hard.
If you haven’t seen yet, Twin Peaks got a third season back in 2017. It’s a lot more like Mulholland Drive and Inland Empire than the original show, but personally, I think it was one of the most amazing shows I ever watched :-)
Not sure about that. Too many chefs spoil the broth. And in most cases, if this one single engineer has the proven track record, I'd give his opinions and decisions slightly higher weightage but at the same time, dictate that he run through his decision making process with the rest of the team. Think of it as forcing him to communicate/knowledge share so that the rest of the team can keep up, learn or simply be convinced. Otherwise, the session serves as a Q&A for the rest of the engineers to shoot. It makes this 'rockstar' a more wholesome engineer in the end, whether he buys it or not. Communicating well is more difficult than perceived, and it's definitely a critical competency to master if you want to really call yourself a rockstar/10x techie.
Well, I'll start by saying I'm not familiar with any of those tools. Took a quick look at them though. It looks like Paraver offers a time domain look at performance? And cube seems to offer time based and a graphviz of the call tree.

In a flame graph the width of a stack frame correlates to the % of CPU time spent in that stack frame, and the y is the particular call stack.

This means that you can quickly tell what functions, and from what call sites, are the most expensive.

The only visualization I know of that matches the ability to quickly zero in on things, while maintaining context, is a graph of call stack with frames colored by cumulative CPU time, but that has the issue that laying out the graph is hard, and seeing everything at once is difficult.
I think this ideology is partly because being a God's special companion means you can rule over others. So it's a convenient patriarchal fiction for many who want to rule over others, with God on Their Side.
I am assuming the us navy must have some plans to protect carriers they don’t make public. Because otherwise using them in the open seems nuts.
This is a really good list of feedback hyperpape.
If you've got Outlook or some other calendaring tool, fill it in with each external request when you get done with each one... when performance is questioned, you can review the history and hopefully get a more reasonable, "oh, I see" level response.
I think deepfakes will force us to think deeper into words and meanings, not just familiar faces. It's an inevitable invention.
Unless there's a bug in the dependency solver, isn't this a good thing? conda is preventing you from installing incompatible packages.
Granted, I'm just a scientific programmer, but my workplace has a full blown software team maintaining a multi million line codebase. That codebase is rebuilt every night, and as I understand it, you're not allowed to submit a change that breaks anything. And they have people whose job is to keep their tools working.

What people casually think of as "Python" is really a huge dynamic ecosystem of packages. Imagine that there are 60k packages, each with 1k lines of code... that's a 60 million line codebase, and it can't be checked for breaking changes. Short of continually testing your code against the latest versions of packages, you're going to hit some bumps if you haul an old code out of the vault and try to fire it up on a new system.

I don't know how Javascript developers handle this.

I handle it by running Python inside an isolated environment -- WinPython does this for me -- and occasionally having to fix something if a new version of a package causes a breaking change.

The drawback of my method is deployment -- there is no small nugget of code that I can confidently share with someone. They have to install their own environment for running my stuff, or take their chances, which usually ends badly.
Online Job
What do you think about online jobs in us
The Scientific Problem That Must Be Experienced
> I normally end up getting my actual work done late at night after an early dinner, which my wife is not particularly happy about.

Whatever else you do, don't do this.

Work is simply not that important.

If you constantly perform miracles, no one is inclined to fix the problems.
It's more like google is a dystopian spyware company trying to suck in as much data as possible. Not that the news sources are great, but google is genuinely far worse.
Linkinator: Scurry around your site and find all those broken links
Cool post, and pretty spot on. I've been doing this with Ruby apps, many of which interact with a
browser, and I have some additional thoughts:

- If you're running MacOS Catalina, make sure that you are using the Python version of
Docker-Compose, not the compiled version that Homebrew installs. There's a bug with
PyInstaller where it needs to fetch resources from the Internet after running any Compose command.
This can add significant startup latency.

You can you `pip3 install docker-compose` to install the Python version over the "Homebrew"
version.

- If you want to do quick contract testing against your API without running a ton of code, Dredd
is your answer. It runs tests against your OpenAPI YAML docs, which is super nice.

- Compose services start asynchronously, meaning that your database might not become available by
the time that your unit tests run. While I would recommend mocking database responses during units
and spinning up local database instances for contract or integration tests, if you need to do
this, ensure that your tests have some kind of code that synchronizes your database against your
unit tests.

- Speaking of databases, data within containers is ephemeral, meaning you _will_ lose it after
every test run! Remember to use the 'volumes:' block to specify where you want your PG data
volumes stored, and if you're using your Git repository for storing this data, ensure that you
.gitignore it (unless you need to have test data pre-populated for your tests to work)

- If you're going to do any browser automation in Compose, the easiest path will be to use
Selenium Hub and have separate Compose services for every browser under test. I have an example
of that here: https://github.com/carlosonunez/bdd-demo

- If you're doing any unit testing for functions that will eventually run within AWS Lambda (or
any cloud-FaaS, really), and your functions rely on a headless browser, I would _really_ recommend
finding the most lightweight WebKit browser that you can find over Chrome and then
use the `lambdaci/lambda` Docker image for EVERYTHING. I had a REALLY
hard time getting Chrome to work within Lambda even though my units were passing, despite
disabling shared memory, GPU usage and all that other jazz. I eventually landed up using
PhantomJS (deprecated) to do what I needed to do. Node has better support for Chrome on Lambda,
but only marginally so.

- `docker-compose run` does not expose ports to your host; `docker-compose up` does!

- As you get more familiar with Compose, you will be tempted to use Docker within Docker. Avoid it
if you can. Making host volumes accessible to nested Docker containers is a MAJOR pain in the ass
and adds a lot of complexity.

- As a general unit testing tip, you shouldn't need any network access for your unit tests. if your
unit tests need internet access for anything other than fetching dependencies, then you might want
to consider refactoring your tests.
Online Earnings
What do you think about online earning is it true or not please say somthing about it
I recommend asdf for version management if you use more than one programming language
In the US those options don't exist. The whole field has found its maximization of variables at worse service, where the variables do not include customer satisfaction.
Cool post, and pretty spot on. I've been doing this with Ruby apps, many of which interact with a browser, and I have some additional thoughts:
We have to prove some sort of monopoly, but looking back at Microsoft Windows and Internet Explorer should give some legal framework.
Thanks. I actually walked into my office Monday morning a few weeks ago, and told everyone "I've got it! I'm going to make an idle game about running a development team!" so I've spent a little while thinking about various mechanics.
Ode to Mercury
on gallilleos shoulders i stood ,

400 year old these shoulders stood,

long dead they breath life,

upon this perch our celestial spirit resides,

and upon them optical engineers and our cohorts,

buttressed by one mans inspiration,

and before him zupis & timocharis and more,

never shall we know their names,
from them messages sent to the stars,

and from the stars to us ,

their spirits return.

p.s. i watched the transit today with amateur astonomers of new york. inspiration and education. thank you aaa.org and everyone at the lower east side amphitheatre. Thank you.
Just because you understand a specific scientific term doesn't make it cromulent. Plenty of pop-sci articles are perfectly approachable and eschew gratuitous jargon.
Cheers Ivan. That’s exactly what I was hoping it would show.

There’s no cross-skilling available at the moment (I want to add this to the store) but that would demonstrate the value of cross-disciplinary team members.
On Starting a “Startup”: A journey of a thousand miles starts with a step