skysight-inc/HackerNews huggingface dataset:
LLVM-lua was just an experiment. I wanted to see what kind of performance statically compiled Lua could achieve.

I didn't really need the JIT feature. But I did add support for it because Lua code can dynamically generate/load more Lua code.

I just found that the runtime overhead (memory and stack space) of LLVM was too high for my needs.
It handles my 250 GB library just fine. I imagine 1.4 TB shouldn't be a problem. The frontend JS was written to be as light as possible so it would scale up easily. If you run into any problems post a bug on the github page and I'll look into it

It will take a while to scan the whole thing for metadata, but mStream handles scanning on a separate thread so you can stream it while that's being done.
It allows some of them to flourish. The rest of them just wreck the computer.
I think GP is talking more about software than hardware. Most of today's IoT devices are intentionally crippled general-purpose computers. The only thing that's preventing them from doing everything a general-purpose computer can do, like running a different OS or attacking random websites, is the pre-installed software (often called firmware).

In this case, we might say that the manufacturer has a much stronger responsibility to keep their devices under control than in the case of, say, a typical PC where the user assumes more of that responsibility. The less freedom you give your users, the more power you reserve for yourself. That power should come with corresponding responsibilities.

For example:

- Mandatory security auditing of all pre-installed software

- Mandatory security updates for X years

- Mandatory insurance for damages caused by vulnerabilities in your products

Allow some of these requirements to be met by reusing previously audited and/or independently maintained software, giving manufacturers an incentive to stick with well-tested standard components. Waive some or all of the requirements if the device is allowed to be used as a general-purpose computer and/or all the software is freely available.

Best case scenario: we get routers and TVs labeled "Red Hat Embedded Linux inside: security updates guaranteed for 10 years."
War.
These are the men who are missing out on the great civilized purge of useless, direction-less, education-less, baby dads.
Not practicable anymore. There is no great enemy, the military services don't want these problem children.

Our direction is unsustainable but nobody likes this particular historical necessity.
Looks like they're bringing the desktop browser experience more closely in line with what you get in the app.
Ask HN: How to find mentors?
I've been looking for a mentor outside my company in areas of Computer Science I'm interested in. What's are some ways you can find a mentor?
Web Components powered YouTube preview refresh available
What does a sabbatical mean in the tech industry? Do I get to work on a side project? or work for another company? or within the company at a different post?

I feel like in academia it is easier for a sabbatical as you can go to another university and study something different.
Even for data modification statements, if you can use TRIGGERs, CHECK and other constraints, and/or stored procedures / functions to implement business logic, then you'll be better off doing that than using an ORM.
How I increased the value of my Fitbit with a CSV: a Lesson in Visualization
> populist view that art should be nothing but a strict representation of the real world

I had no idea.
Rebuild Mission Impossible's Security System on Raspberry Pi
Thanks, we've updated the link from https://techcrunch.com/2017/05/02/watch-microsoft-unveil-its....
I miss the days of expertise, you expect doctors to specialize, why can't software developers specialize? I get the point but, its really hard to expect someone in the software industry to be top tier at something when they are expected to know everything.

Basically I think developers need more focus instead of the industry expecting us to know everything. I am not saying that we shouldn't know or try to learn different things, but its really hard to become the best when your spending your time on frontend, or backend or tweaking the database or algorithms there is just so much going on. people just need time, just like doctors need time to become a good doctor, developers also need time. People who really get this understand how to build teams and good engineers in which inevitably leads to a good product.
I agree, very cool.
From my own personal experience, I can't agree with this statement in software or in any other human endeavor. An individual in the 99th percentile of talent may be several times more productive than an individual in the 50th percentile of talent. The same goes for an individual who expresses the behavioral adaptations we describe as persistence, effort, and hard work.

The person who has both rare talent and applies total effort may produce 1 - 1.5 (and perhaps occasionally more) orders of magnitude more value than what is average.
It's not a "sexy" stack to talk about, but I don't think it is going anywhere. There are quite a few Windows Store applications built on it, including several first party applications from Microsoft themselves. It's a quiet workhorse stack that does the job and gets out of the way. So quiet I don't think people often realize when an app is built on it.
I saw Mike Stonebraker while he was on his VoltDB "tour" a few years back. He makes the same arguments. In his talk he walked through the history of database technology and discussed a similar "war" between CODASYL and SQL. He framed that debate in terms of the split between separating the concerns of your data's structure (schema) from application logic.

Fairly or not, he suggested the current fight between noSQL/Schemaless vs SQL/RDBMS was being fought in ignorance of all that went on in the 70s.
I've had Pingdom for about three months now. They have failed to alert on every outage we've had since I started INCLUDING the first "test outage" I created on day 1 to verify the monitoring was working. I am not impressed at all by their service and will probably be asking for a full refund depending on the outcome of my current trouble ticket with them. Also they've been deleting history of our outages after the fact; i.e. an outage occurs, they fail to alert but they do log it, and then several days later the outage is removed from their history. Pingdom is run by absolute clowns.
the surface laptop isn't a chromebook competitor, it's more of a macbook air/pro competitor. the windows 10 S based laptops manufactured by asus, acer, dell, fujitsu, hp, samsung, toshiba are the real chromebook competitors. i think its basically windows 10 S Vs chrome OS.
What benefits accrue to single parents that you have a problem with?
I can already use the mouse normally in vim... is it that the configuration is too hard?
I dunno, I just spent a couple thousand on a Dwarf Fortress machine. It's still single threaded :(
Thanks to you!

Yes, there is always that possibility, is a question only of time, more tests implies more time to complete the full batch. And of course, more time to implement it.

I have the intention to keep improving it, and thanks to the Ansible tags, the tests can be run individually and independently (I tried from the beginning to make them as atomic as possible for this same purpose). Thus is very easy to extend.
I imagine if there is news to share on that front, it will happen at Microsoft's developer conference, which is next week. So don't give up hope yet.
Yeah, but then the premise is just a tautology: education that doesn't teach you what we consider important is a bad education. I mean, it's a lot of energy to spend thinking about a such a poorly-conceived essay. Or is it badly conceived?
That will need to be a separate app. There isn't a place for it in jolt, but I do think it could be another fun side project to work on...
.... yup, also him going in randomly through the day and killing proc's id's and clearing out log files at random was other issues where reported. I think for development to avoid him and get some level of sanity we used AWS and install ubuntu/postgres/java sdk to get work done.
Awesome article. I just read with my morning coffee, and I have a big grin.
There aren't very many query languages for relational DBs that come close to SQL's power.
Actually, they did not design anything, or that's not described in the article.

Besides, no mention about the fact that there's a complete lack of graphics drivers for ARM under Linux, which is one of the most problematic issues for anyone who wants to build a desktop/laptop with it. No ARM SoC manufacturer has any open source effort for drivers, and reverse-engineering efforts have stalled for the most part.
There's a lot of good stuff here. I'm surprised about their take on speaking engagements (they're OK as long as they don't involve multi-day travel obligations). I get that you don't want team members touring talks or becoming conference tourists. But a lot of companies want their employees doing speaking engagements; Matasano/NCC, my old employer, pays a pretty substantial cash bonus for every time you do that.
But they are fixing it. And there is incentive. People are just upset that it isn't happening faster, so they clamor for more incentive. IoT is a new born baby in an industrial filled with 3 year olds. I guarantee in 100 years, we all will seem bumpkins developing the WORST ideas of security.
I agree — as someone who hasn't bought a Surface or a Surface Dock, a proprietary version of Thunderbolt 3 or USB-C is a step back, not a step forward.
I'm at the point where I simply don't believe a word hiring people say about hiring anymore. I have 20 years of experience at world-class companies, and have shipped multiple very well known products that have collectively sold ~150 million copies. I've had nothing but stellar performance reviews and LinkedIn recs. Coworkers and managers have told me often that I'm one of the best devs they've had the pleasure of working with, and I believe they meant it. I'm very comfortable with every major OS and language, and every stack level.

Nobody is going to pay me $500K. Nobody is going to pay me $200K. As recently as 2015, I still had well-known companies trying as hard as they could to bring me on at under $100K! The last time I talked to an SV company publicly claiming to offer $250K, it turned out they were reserving the "top end" for imaginary devs. My work experience only weighed in at $150, according to them. Also, despite having a very rare combination of two unrelated specialties (the reason I applied), and being proficient in 6 languages, including JS, they passed because they felt my JS experience was too light. Writing the AJAX and UI framework used by a team of 30, and working on the front end of a major portal, both at BigCo, were apparently too small-time.

My whole career in the industry I was aggressively low-balled 9 times out of 10. Hiring people can't hire who they want, because they're scheming double-talkers, and they've convinced themselves that it's just good business. I started a small business that pays the bills, and I've never been happier. I sincerely would not go back to the industry even if you did pay me $500K.
Waking up to a song I dont like I think is more unpleasant than an alarm. Is there anyway you can tap into Spotify, Pandora or Youtube api?
Sorry for the downvotes; I upvoted you to correct. I think it's an interesting question. There are probably fields where it's possible and fields where it's not.

Some students certainly outperform others by a factor of ten. I'd hesitate to score managers numerically, but it seems plausible that working for one could feel ten times more smooth or whatever than working for another, whatever that means. Intuitively, probably not factory workers, but prove me wrong.

10x is not actually that much. I could play basketball with Michael Jordan or chess with Magnus Carlsen, and they'd win essentially an infinite number of games against me without losing once. That doesn't mean they're infinitely better, because theoretically I could through practice become as good as them, but the factor is way more than 10.
That sounds like it might be difficult to sustain, but this kind of hand curation is the surest and easiest way to consistent quality. Thanks for doing it!

You might want to considering billing this as part of the product's description. My biggest question coming in was how the music was selected because I wanted to know if there was some mechanism to avoid genres that I'm sure to hate. I had to come here to find my answer.

I'm looking forward to trying out Jolt tomorrow.
Would love to see Joyent included. Silly pricing, hopefully performance that justifies it.

https://www.joyent.com/pricing/cloud/compute
Show HN: Newco-legacy, open sourcing a failed startup
The issue is that it's a process that needs to be kept in mind from design through development. There's a sound process, but it's not something you can apply afterwards, and obviously it adds cost.
Back in 2012-2013 I worked on a startup project called NewCo, as in the New Company. The idea was to offer a place where consumers would exchange information about the products they used and loved thus empowering you to make better and faster buying decisions.

We never did any money, except like 30€ through affiliate programs, that's why we failed. Also because of strong disagreements between the co-founders ;)

Long story short, the original website is still running at: http://newco-prod.herokuapp.com/ and I wanted to replace a feedback form that no longer worked by some comment about the startup story. Problem: I could no longer run the website locally and my code push were rejected by heroku. Two days of rabbitholing later I managed to rebuild and deploy the app and decided to opensource it: https://github.com/blaze33/newco-legacy

We always hear a lot of success stories and I thought it might be of some interest to HNers to show you the work of a failed startup. I left some advice to future entrepreneurs in the README.

The stack is old: Python 2.7, Django 1.4, Heroku cedar-14 (upgraded from cedar-10 this week-end), redis, postgresql, celery.

Feel free to share your thoughts, but be warned this is a messy codebase, we were young and unexperienced ;)

I should be online this evening if you have any questions.
In real-time.
Your wrong in terms of how VIM came about and name.

VIM originally meant "Vi IMitation". It wasn't till 1993 that it became "Vi Improved."

Actually VIM is not a direct fork of VI. VIM comes from Stevie editor from Atari ST and Amiga days. (I actually started with Stevie).

Here is the tree from ed to VIM

ed > Bill Joy and company then made em > en > ex AKA vi

Joy left development of VI in June 1979 and joined corporate life working with BSD.

vi (Unix\BSD) > Stevie editor (Atari ST) > VIM (Amiga)

Then chaos hit. From 1981 onward clones and implementations were incompatible and progress kind of grind to a halt due to license. That is when Stevie editor hit and then when Bram Moolenaar made VIM. He reimplimented it for Amiga and added features one being plugins. Vi had no plugins and very little customization.

Here is why your analogy is wrong: LICENSING "While commercial vendors could work with Bill Joy's codebase (and continue to use it today), many people could not. Because Joy had begun with Ken Thompson's ed editor, ex and vi were derivative works and could not be distributed except to people who had an AT&T source license."

So it is not at all like this fork. I find that people have taken sides without even knowing the history of VIM and make assumptions.
A minute fraction of kids will use the ability to install downloaded software to flourish. The vast majority of children will just download games, malware, and porn. Society should be more honest with itself about the simple reality that the vast majority of children are not and will not ever be special.
That's not enough: they can demand that you unlock the device at the border, including powering it on. If your battery is depleted, they'll give you a charger and wait. If you refuse, they can and will confiscate the devices. You can't outsmart them: for pretty much every major country, they're better at this than you are.

They can do all of this even if you're a citizen. In the US, citizens (and, to a lesser but still meaningful extent, LPRs) cannot be denied entry to the country. But you can still lose all your devices. You can be detained, potentially overnight, no matter who you are. If you're not a citizen, you can be detained and then sent back without your devices.

The only realistic answer is not to have sensitive data on your devices at the border at all, nor any indication of where your sensitive data is or any means of getting access to it.
Should I fire a software engineer for working on side projects during office hrs
Multiple ISPs I work with have explicitly stated to me that it was Telia. I'm not aware of any public sources confirming this yet.
Not to mention this recent 6-min video, on sound & narrative

How Nature Documentaries Are Fake
https://vimeo.com/214023666
It's Redhat, whose focus has always been enterprise the money maker.

Ever since it dumped the desktop years ago, I switched to the deb ecosystem and never looked back, do not want to have anything to do with Redhat,including this openshift thing, one reason is for the "dump-the-desktop"(please don't mention Fedora), another is that, DEB is so much better than RPM for my daily life.

I also hate the Redhat-intrusively-forced-on-SystemD to my heart.

That been said, I appreciate what Redhat have been doing to the open source, I guess it is win-win for the community and its own business goals.
N2O Protocols Over MQ Telemetry Transport
With IoT, one generally has control of the devices, so one can distribute their own keys without having to "trust" the authorities. In that case, something like libsodium could handle the communication between devices.
Here's a copy without the paywall: http://www.4-traders.com/FACEBOOK-INC-10547141/news/Facebook...

tl;dr: diversity hires noticed that they have 35% more code review rejections than the awful meritocracy crowd, blamed it on the oppressive patriarchy

Excellent opportunity to remember the story of Saron Yitbarek - a fresh developer out of a 4 month Ruby on Rails course who was hired by Microsoft for more than a year, but not as a developer, because technical interviews are sexist. The software giant hired her as a project manager for a newly created program to... teach students how to write CVs. The outcome? https://medium.com/startup-grind/i-dont-belong-in-tech-3d73d...
That's remarkable. How did they get the USB-A port in there? The MacBook Pro body is thinner than the type A receptacle.

Edit: Looking at this picture https://cdn.arstechnica.net/wp-content/uploads/2017/05/surfa... and there's even substantial space around the type A receptacle. I honestly don't understand how it can be thinner than the MBP. I look forwards to seeing one in person.
Tried OpenShift last time and their cartridge model didn't make sense. What has changed since then?
> The biggest problem is that SQL has no well defined "compile time". For all practical purposes, it's always an interpreted language. I can't check my code against the production database without running it.

I get what you're saying but I've seen that as a pretty common problem outside of SQL as well.

Firstly, and sorry for the nitpicking, but it will explain my point, I don't think the "interpreted language" is the right description here. Nearly all modern "interpreted" languages are still technically compiled, albeit it's bytecode that's then executed by the language runtime. Usually when people talk about interpreted languages they're talking about JIT compiled (like Perl, Python, PHP, Ruby and Javascript, to name a few) but technically one could argue that Java and other, similar AOT compiled languages are also interpreted. Even some AOT compilers that produce a Windows PE's (.EXE files) and Linux ELF (for example) will be interpreted (either that or JIT compiled to machine code when executed).

Anyhow, the reason I raise that point is because there are a lot of parallels between SQL and other JIT compiled languages. With JIT compiled languages, they are obviously still compiled - even if it is just to bytecode. But in many cases the compiler will perform many of the same sanity checks that an AOT compiler would. Likewise SQL is compiled albeit by the RDBMS to something that's optimised for execution on that platform and it's during that compilation that table names and types are checked. And much like a JIT compiled language, you have to make a few assumptions about the running environment when you write the code .eg the same and correct Perl cpan or Javascript npm modules are installed on dev, UAT and live environments; or with databases you have to make assumptions that your dev database schemas mirror your live database.

The problem RDBMS suffer from is that some of the solutions for the JIT compiled environment problem (eg docker) don't work so well for databases because you're dealing with data which can be sensitive and is often in flux, rather than code which should be pretty much unchanged across the deployment pipeline (whatever that may be).

The data is the key problem here. If you wrote a C++ routine to handle data encoded in JSON files then you'd still be at the mercy of executing your program to check it can parse the data correctly (eg the field names are correct and the data exists). Likewise if you wrote the same routine in Haskell. Or if you replaced JSON with XML, YAML or CSV files.

I'm not saying SQL is without its warts though nor that a functional-paradigm reimagining wouldn't be better. But I do think some of the biggest challenges with SQL is data related and thus could very easily rear their proverbial heads in other languages too (particularly if you don't want to trust your language to perform too much background magic for fear of risking the integrity of the data you're retrieving).
Download is not the problem, the 10s start-up time is, as is those 100 MB RAM usage, even worse if you hit swap.

Why use JS when you can have Lua for scripting and a less annoying programming language for main code? Why use HTML and CSS when you can have a dynamic portable native UI as in Qt?

I smell laziness and cutting costs in those decisions, or rather offloading the costs onto users.
You're talking about a different kind of "type safety".

I mean that when I write code to consume a message, I would like to detect (at compile time) if I typo a field name, and I also don't want to worry about what happens if a (possibly-malicious) sender sending me a different type than I expected.
openshift.io (please watch .io) is a complete cloud native development environment for organizations, having work spaces created for collobaration, IDE with Eclipse Che, complete build, pipelines along with analytics to deliver actionable insights to the developer for choosing the right software components. All this happens in a Browser..
Room temperature superconductors would certainly help a lot.
Is it possible that the hiring standards for women at FB is lower than that of their male counterparts, resulting in a larger number of issues with their code? Maybe it's not bias in the code reviews that are leading to this gap but rather bias in the hiring policy.

I don't work at FB, but it's possibility. I'd like to hear from those that do.
I may be behind the times, but last I checked there was no way to use JITed JavaScript in iOS apps. Or maybe you could put JS in a hidden webview, but bridging to native was extra slow with this approach?

While LuaJIT can't be JITed either on iOS, I think the general consensus is that non-jit Lua is faster than non-jit JS.

I do a lot of bridging Lua to native, and that's another area where Lua is often considered more efficient.

Again, these thoughts may be out of date.
> It deliberately sacrifices run-time efficiency

I'll pass...