skysight-inc/HackerNews huggingface dataset:
Unfortunately my data isn't all numbers. It has text too. The sparse examples in that link only show this for reading in numbers. Do you know off hand if it translates well? There is a dtype parameter, but it'll take me a few days to get back to this code, so I figured I'd check beforehand.

Your second paragraph is essentially what I want. I'm willing to wait a day for code that may run in 1 hour from memory, so time isn't entirely an issue unless it's starting to bleed into weeks. The read_csv function in pandas has a parameter called memory_map, but when I tried using it on a smaller 7GB dataset, it read the whole thing into memory (32GB instance) even when I set it to True.

SQLite is definitely not my best option here. It was the only server-less implementation I could find, so I tried to use it and it didn't work. However, a database like implementation will be helpful because each operation I need to do will require data that satisfies certain timestamp and arithmetic conditions. I figured it'd be best to load the whole thing into a db and query it for every operation to train my model.
What was the cost per card if you don’t mind me asking?
the comment I was responding to (from you?) said:

>I've only had issues twice in the last 12 months,

which is often enough, for me at least, to want to carry a backup, just 'cause it's super awkward to eat and not pay, regardless of who is responsible for the equipment failure.

(I've been using the atm-via-cellphone thing and it is pretty neat, though mine only lets me use atms branded with my bank, which diminishes the utility for emergency cash. I think mine (at least Bank of America and Chase) does involve some sort of NFC? I can start the process by waiving my phone over the ATM, which resulted in me looking like an idiot, waving my phone trying to get it to work on other bank's ATMs. Reminded me of how when I first got an electric car (not a Tesla) I pulled into a supercharger and it was... several minutes before I figured out that the supercharger was Tesla-only. )

re reading this, I'm beginning to wonder if I have a stronger than usual aversion to seeming like I don't know what I'm doing? it's not something I've really thought about before. Huh.
"...self-modifying code, [is] sometimes appropriate to solve certain problems that have no other solution, or for improving efficiency, as in double-indirect addressing."

I have read that self-modifying code on the x86 architecture is pretty dangerous at the assembly level.

More broadly, this kind of comes back to all the issues in the "C is not a low level language" thread. Some level of assembler certainly gives the programmer as full access to the machine as possible. But naive assembler from the 8086 - 80486 eras is going to be rearranged in a lot of ways in a modern Pentium processor and counting on in-order execution may be a mistake.

Edit: at the same time, the modern processor doesn't really allow a lower level than assembler normally and the default approach is assuming flat memory but being aware of the pitfalls of multiple caches being involved.
> Does it work with Raspberry Pis and the CSI cameras? What about my Logitech USB camera?

I don't know details about the Raspberry Pi cameras, but if it's a UVC camera (quite likely) then it should be supported by this library according to the documentation. A USB Logitech camera should also be supported. The gotcha is that unless those cameras expose advanced functionality (3A, multiple stream support, etc) then you don't get any benefit over using the standard V4L drivers.

> Would it support receiving a picture from eg a flatbed scanner over a parallel port?

I don't think scanners identify themselves as camera devices, but someone can correct me if I'm wrong.
This is no simple thing to do.

The biggest issue is that "raw" Linux is not an RTOS.

When the photographer presses the shutter, you have a few milliseconds to capture the image. You can't have the OS decide to prioritize receiving a tweet before getting to the shutter release.

It's even more intense with video, and most still cameras are quickly morphing into high-quality video cameras.

Also, image processing is REAL intense; especially with Computational Photography. It can suck down your battery in seconds.

There's a few ways to deal with it. You could use something like Xenomai or RTLinux, or establish some kind of SoC for the realtime-sensitive processing (what most phone manufacturers probably do -Apple sure does).

It's a non-trivial task.
i like it. Having to scroll through long vertical list of tiles to find the one you want is kind-of a pain though. Other than that, nifty. :)
Tried that, found the result gross to look at.
Does anybody have resources on the math behind ML? I hit a dead end using Python frameworks because it was a black box, and I simply lacked the underlying knowledge.
Yes, I'm starting to awaken to the fact that at this point we're no longer talking about income but disposable income. The points about what you're calling essentials. I'm trying to think about this mathematically, this is what I'm feeling out so far...

Premises

X = income
c > 0 (income difference)
p = tax rate
e = some expense

==> X+c > X (income inequality)
==> (1-p)(X+c) > (1-p)X (income after taxes)
==> 1/[(1-p)(X+c)] < 1/[(1-p)X]
==> e/[(1-p)(X+c)] < e/[(1-p)X] (expense relative to disposable income)

Like with many things people mean different things by the same terms. I'm thinking more along the lines of the second investopedia article which makes the point of This type of tax has no correlation with an individual's earnings or income level.
That's easy to test too. Run the boiling-to-dryness test once with tap water and once with bottled water. Try the same with a Brita filter pitcher. I don't think that you will observe any more plastic in the bottled water than in the tap water.
A Cryptocurrency Year-in-Review for 2019
Since GH URLs are github.com/<name>, you also can't register usernames like @login, since that would cause a conflict. However, @case-studies and @customer-stories both are content pages (well /case-studies redirects to /customer-stories) and users. Those two users also cause weird things when interacting with the website and API.
One day MDMA legalization will significantly reduce both alcohol consumption and DUIs.
No, GP is right. The prosecutors on the case are part of a division (特捜部) that is under pressure because they're mostly useless and have botched previous cases. If Ghosn is not prosecuted or is acquitted, heads are going to fall.
Over time, yes, but I suspect the per-second bitrate is extremely small.
> Personally, I'd rather earn an extra $25k and buy a few cups of coffee with it than get "free coffee".

That deal is not on the table, though. For practical purposes, there are few places that someone can work that pay better than Google for a given dev, and those places all probably have free coffee as well.
I won't argue for or against marijuana, but I disagree with your argument.

Some drugs are capable of permanently transforming a "sane" individual into one with psychosis or other permanent mental disorders. Even alcohol has been shown to have this effect in some heavy long term users. It's even more common in meth users. It is not "pure bullshit."
>Clearly video games are not priced at the marginal cost of production, which is just the cost of transferring a few GB. Are you suggesting they are currently or they would be with allowing resales?

well they'd drop in price heavily. They won't come down to the marginal costs because as you correctly point out AAA titles have high fixed costs in relation to their marginal cost so if the firm wants to continue to exist they can't charge zero obviously. But yeah most competitive digital goods actually do approach their marginal costs of production, which is why so many of them cost something between a few dollars or nothing, see newspapers.

And actually pricing the good at the highest first world rate isn't possible (or at least not rational) because in a market with resales those consumers can then go on and sell their games, taking your revenue (that's why competitive markets push the profit down in the first place).

> is more consumer-friendly than pay-per play experiences like movie tickets or in app purchase based games.

I think that's because (I would guess) you've got a bias towards this business model and dislike other ways to monetize games. But for consumers at large (who don't mind those experiences if their decisions are any indication) this model works very well.

Also keep in mind that the economical point above (that competition drives profits to zero)d does not imply that the company goes bankrupt, it means that the company only gets to keep what it costs to produce the product, it is still a perfectly plausible business.

And culturally speaking, a lot of great games were developed in environments without much copyright protections, reselling rights (literally every game before digital platforms could and was trivially resold). Almost all my favourite single player games precede the online platform era, and anecdotally I'd say there were more of them. We don't really need to give EA or Disney surplus profits by protecting their market power.
It's a direct consequence of an explosion of private sector / VC funding into "risky" biotech bets. Will be very interesting to see how this plays out!

A16Z also has a podcast with George Church (who sums it up as "multi-disciple" people who are taught to "fail fast" and explore low-hanging theoretical and experimental fruits) ;)

What’s in the Water at the Church Lab? A Conversation Between George Church and Jorge Conde

https://a16z.com/2019/02/26/george-church-genome-sequencing-...
Context over Control: How Netflix Gives Every Developer Access to Production
Zimbabwe Inflation Still on the Rise
Unfortunately, I'm not sure what's wrong with dask, but it doesn't work properly on my cluster. I tested it on an exceedingly simple operation - find all unique values in a very big column (5 billion rows, but I know for a fact that there are only 500-502 unique values in there). With a 100 workers, it still failed. Now this is an embarrassingly parallel operation that can be implemented trivially. So I'm not sure if there's a problem with my cluster or if dask just does not work with slurm clusters very well.
That just means it's time to replace you with a fresh graduate.
Yes, but tap water isn’t bottled water. It’s been shown that plastic beverage containers leach plastic into their contents.
I thought Ireland was forced to close that loophole. Wow google is such a good honest company.
> I have no formal training (...) I have real time models that run on the CPU (..) and as far as I know they're more performant than anything else out there
> You do not need to be a data scientist. Anybody can do it. That said, a good GPU will help a lot. I'm using two 1080Ti in SLI and they're pretty decent

An alternative is that, by not knowing what you are doing, you may not see all the options that exist -- and when you hit a problem too hard, you just throw more hardware (GPUs) at it.

This is not to say it is not sometimes a valid approach, but I'd be wary of someone who say hasn't had any formal training in C, and says that his stuff is more performant that anything out there- just because lack of training causes not knowing stuff that already exists.
Worst case is you take the standard deduction. After being doubled in Trump's tax bill, it's often the right choice too.
while opioids are clearly awful when abused, they are at least a controlled substance and a bit expensive. There are MANY more people who manage pain with alcohol due to it's price point and availability.. I'm very interested to see the effects there. a quick search turns up some papers, but nothing recent or with any significant data..
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4700545/
Henry Finn Built $2M/Year Video Production Company
Define greatly. The amount they stand to lose from just chronic pain medication vastly out strips any potential profit from treatment of maybe slightly increased cases of schizophrenia.
I don't think I have any shell extensions installed. I did allow git, 7zip, and clion to add themselves to the right click context menu, but I don't think that counts as a shell extension?

I do have WSL installed, but only for curiosities sake. I messed around with it for a few hours and have not used it since.

I'm using git with the terminal editor that they recommend to you in the git for Windows installation, I think it's called git with bash? It could have been some type of issue there rather than Microsoft being at fault. But that terminal editor is (or at least was) the recommended option presented to you in the git installer, so shrugs
Maybe we get

[1] https://en.wikipedia.org/wiki/Aneutronic_fusion

working in another '50' years? :-)
Never had any problems with this site before, but that layer (and all the other air quality layers) are just not showing. Does it work for anyone else in Firefox on Linux?
That might send output to the printer. I know on the TRS-80 Color Computer, the printer was #-2.
While this is obviously a noteworthy report (in this day and age, it's amazing that flight clearances are still given over voice - FM radio - liable to mishearing and interference, and generally pretty terrible for pilot workload!) - this wasn't as dangerous as the title implies. All modern airliners are equipped with TCAS (Traffic Collision Avoidance System) which will automatically instruct pilots to avert their course and take evasive action if it detects a converging flight path: this is totally independent from air traffic control and pilots are mandated to follow TCAS above all else. The flight paths weren't converging in this case (there was just a loss of separation) but if they had been, both pilots would have been commanded to avoid each other.
Not always accurately either for those who have been unlucky enough to have received a corrected W2 or whatever said form is.
https://www.irs.gov/forms-pubs/about-form-w-2-c

We have to remember too that the government itself is dealing in approximations and assumptions of its own. People make mistakes including those in government and corporations.
My Personal Highlights of 2019
How did you find these documents? I spent a considerable amount of time on the IRS website and never found anything even mentioning them.
I understand that @randomascii is responsive, perhaps he could help with analysis. I see an email address on his site's About page.

Also, I got curious about the perf collection process, and stumbled on https://blogs.technet.microsoft.com/yongrhee/2017/10/11/usin... - unsure if this will be useful.

Also found https://randomascii.wordpress.com/2015/09/24/etw-central/, for completeness
> I have no doubt I could solve your problems. I honestly don't care to do so here though.

That's fair. I did not think it'd be such a difficult problem when I first set out to do it myself. But every single turn leading to a dead end kinda bummed me out. I'm going to finally resort to the database method of storing all the data in one query-able file and work off of that.
That's a long ways off, to say the least.

I wouldn't recommend waiting for many years to get a 200% improvement when you can get one now that's an 180% improvement and then upgrade later on if you want to.
When I see these types of research, I wonder if it is a short-term or a mid-term effect of marijuana legalization. There was a time when Heroin was a legal trade-mark that was available over-the-counter... It was thought that only weak could get addicted to it while short-term effects were recognized.
Not just the German economy. Much of the traditional US and Japanese car (and truck) industry is at risk too. Complacency leading to a lack of R&D is enabling new comers to ship products and establish themselves. Toyota, Mazda, BMW, Chrysler, etc. have in common that they don't seem to have plans to mass produce EVs in a market where Tesla is taking the #1 position in several key markets. It's not a given that any of them will survive while their market shares crumble, typically starting with the most lucrative segments. The supply industries around them are suffering a similar fate.
Link to the original article (and the remaining posts in the series) here:

https://ansonvandoren.com/posts/esp8266-captive-web-portal-p...
At the risk of facing the wrath of developers, they also choose products that are not are not necessarily clever, but makes them clever. e.g: IaaS Vs PaaS, C++ Vs Visual Basic etc.

Developers usually say that abstraction doesn't give them enough control/flexibility. That might be true in some cases. But in most cases, they are afraid that abstraction will make them dumb, instead of making them clever.
You might consider it too much of a premium, but Loop¹ will send you familiar brands of consumer goods in reusable packaging.

¹ https://loopstore.com/
As recently as a year ago I used built in assembler in Delphi to perform some low level timing. It was not for just super-duper performance though. Surprisingly it was the most straightforward and simple way. Meanwhile my firmware for 3-Phase AC motor torque and speed control for really low power micro controller was doing fine with plain C without any assembly.
Not sure I ever understood the haskell folks drive. Is it mathematical poetry? An extreme attempt to simplify? Is this an intellectual equivalent of trying to write poetry?

The words catamorphism, semigroup and monoid barely make sense to most programmers.
Thank you for your opinion. Great point.
Right now, it's not much different than Postable or any number of similar services. Except they can send internationally and this service cannot :) Based on the number of similar services, this doesn't seem like a winner-take-all market. But I would be very interested to hear your thoughts: how you chose Postable from competitors, what you like about them, don't like, etc.

A little extra context: when I first built this, it used the Instagram API to automatically mail postcards to my mother when I uploaded a new photo. Shortly after building it, Instagram changed their API and I was unable to get high enough resolution photos for postcards, so I "pivoted" it to the current product.

How is it different in the future? I think I can win on price-- it looks like Postable is $2.49 low volume and $1.00 at volume. Based on my costs, I can do $1.00 or lower with low volume.
Having a tax lien on your business is not fun. Neither is going through the settlement process. You also are not guaranteed a settlement and could end up owing the full amount plus interest. At best they let you pay it over time. At worst they take your property and liquidate it. But jail time is unlikely unless you had malicious intent.
I’d like to see Apple buy Truecaller and then actively keep a database of spam callers.

Here In the UK I’ve lost count of the amount of robocalls that say “We heard you were in an accident”.
17 USC § 512(f), knowingly misrepresenting a DMCA takedown claim can result in liability for damage, attorneys fees, etc.
I think Portugal prescribes some substitute drugs like methodone to some addicts as part of rehabilitation therapy, but this isn’t unique to Portugal and isn’t really a significant part of the overall strategy except to treat addiction as primarily a health issue.

Of course that’s a lot easier to do in countries with universal health care. I wish we took this approach more here in the UK.
This is cool! Thanks for this, I had no idea it existed. It looks like the functionality is almost identical. Even the command names are similar…
Why is this your about? It makes you seem confrontational. I read abouts for all types of reasons. I clicked on your username to see the likelihood that you're a bot ;-)

> If you're reading this odds are it's because you're incapable of having a well reasoned debate with someone who doesn't share your point of view.
And yet it has to get there by tax time so I’m having trouble believing it takes some tax forms literally years to make it to DC.

It sounds like you've never needed to file a revised tax form for a previous year. I have, and millions of other people do it each year.

Especially when you go to jail if they don’t.

The IRS doesn't show up on your doorstep on April 16th if you don't file. There's a process. A long, involved process. Even if you pay nothing, it takes months before they start forcibly taking money from you. If you file for an extension or two, it's even longer than that.

Why would information arriving quarterly (bi-weekly even) instead of annually be a bad thing when that information is legally bound to arrive at its destination anyways?

Because the vast majority of America's accountants are one or two person shops with neither the time nor the technology to make this happen. In spite of the rhetoric you see on the internet, the government (via the politicians) doesn't like to make things hard on small businesses unless it really has to.

The only thing you're arguing is that the government shouldn't run their program a few months before you submit the documents, then send it to you for review, instead of afterwards and sending it to a tax judge.

I argue nothing. I merely state facts.
Funnily enough, I had this exact idea ~6 months ago. Whether this becomes a paid service or not, people will always appreciate a little goodwill.
Yes, from the video it looks like the rule is the same under rotations.
I updated my answer above. I googled the tax code section. Pretty much everything you need will appear in the first page of results, or linked to/referenced from those results.
CPA's know what to look for, so it's a bit easier for them.

There are also specialized search engines. E.g. search for 25D at http://www.legalbitstream.com/irs_materials.asp?pl=i1
> I have read that self-modifying code on the x86 architecture is pretty dangerous at the assembly level.

Dangerous in what way?
I started with with the machine learning course[0] on Coursera followed by the deep learning specialization[1]. The former is a bit more theoretical while the latter is more applied. I would recommend both although you could jump straight to the deep learning specialization if you're mostly interested in neural networks.

[0] https://www.coursera.org/learn/machine-learning

[1] https://www.coursera.org/specializations/deep-learning
> I have read that self-modifying code on the x86 architecture is pretty dangerous at the assembly level.

Why's that? I'm not aware of any issues specific to x86.
Configuring and deploying web application before adding business logic
And the corollary how many times have you been driving somewhere and seen someone running by and thought - ah, I wish I'd gone out for a run today. Or that feeling that the more time you take off - the more days you skip - the worse it's going to be when you finally want to go out for a run.
Humblebundle has a bundle of machine learning books right now: https://www.humblebundle.com/books/python-machine-learning-p... I'm considering buying this bundle. Any of these books you would recommend?
Stadtneurotiker
https://skeptics.stackexchange.com/questions/32247/did-ehrli...
Why is marijuana so illegal and stigmatized in China?
> Why wouldn't citizens demand a public tax filing process?

Because they don’t want to make it easy for the government to impose lots of taxes. Americans have the lowest taxes in the developed world. Not especially for rich people, but for everyone else: https://www.heritage.org/sites/default/files/inline-images/I....

This isn’t the work of some secretive cabal of billionaires. Rich people hire accountants to do their taxes anyway. The absence or existence of free tax filing doesn’t affect them at all. But a platform of “we’re going to make taxes painful so the government is afraid to raise taxes” gets a lot of votes. (In my view, is nothing bad about people being confronted once a year with the cost of the government to themselves. I just looked at my taxes for 2018 and concluded I’m taxed too little and would rather pay more for a government that offers more services. But people should be making that decision with eyes wide open.)