skysight-inc/HackerNews huggingface dataset:
It's highly ironic that the ruling party is now receding to the level of the previous govt that they destroyed in the 2014 elections. The UPA also used to offer free things to poor and used to do minority appeasement two years before the elections.

The thing is, this govt came to power in all but 4 Indian states and it has just destroyed the economy. The GDP rate has skid down to 4% just as the previous PM, Dr Manmohan Singh said it would and at that time, everyone mocked him.

Guess who is laughing now?

The current govt has failed absolutely at every way, the Demonetization exercise was a total and epic disaster and it shocked the economy without fulfilling it's motive of "war on black money" as 99% of the invalid notes were returned to the RBI.

But that's not the only problem, the problem is, this govt takes decisions just to win elections. DeMo happened just before UP elections after the "surgical strike" lost it's glitter in the media.

Even the most ardent supporters of the current govt are asking the question, if the earlier govt was able to keep the GDP growth rate above 7 in horrible world economic condition, why is the current govt unable to do so even when the crude oil prices are half of what it was earlier?
Why do firms market so many disparate services?
Not all tasks require uninterrupted attention all the time. Sure, if everyone is working on complex stuff everyone can put on their headsets; no one will disturb others unless required.
Yeah, the laser sound as well I think? :) The instruments for the two songs I made for Voxel Quest were ripped from Star Control and other tracker files.
https://soundcloud.com/gavan-woolery/voxel-quest-song-1
https://soundcloud.com/gavan-woolery/voxel-quest-song-2
The sheep were originally given to me by people who just wanted to get rid of them, I still have a goat that was originally intended for someone else and I had been asked if I could look after it for a few weeks. The person who was to receive it moved into a nursing home and it was subsequently given to me. My 6 year old granddaughter has been keen to be involved with doing the goat, which I'll be doing later. If the weather is still cold when I get back from visiting my parents, I'll be looking at doing it then. In the meantime, he will be fattened up as much as possible.

I have 2 acres just on the edge of town and for many years, we have run some level of stock on it. All of the various beasts have ended up in my freezer. The last lot I killed, dressed and butchered myself (with the help of a number of young people) out of necessity as no butcher would come in for just 3 sheep.

As the sheep had little need to run anywhere and had luscious feed, they turned out to be so tender. I did try to source some more via the local butchers, but found that would be extremely expensive as most of the sheep are culled for lamb and not kept for wool in our region.

If you ask around, you might find some appropriate beasts that you can get cheaply (whether that be steers, goat or sheep). Though you may find getting them to the abattoir and then to the butcher somewhat expensive.
I'm sure we had Satellite data in the Late 1800's, right?...
See also: https://en.wikipedia.org/wiki/Equivocation
labels on moving objects: vehicle, adult, child, bike, T-shirt, etc.
This was a nice read for the history. Honestly, being in a big legacy industry (Insurance), it's as though NoSQL never happened. We're too big, at least my organization, to have made the wholesale change and we've been plugging along mostly in Teradata and DB2 for a long time. Teradata in particular has performed well across a variety of use cases, its only large downside being the cost.

Anyhow, only point I'd add is that I'm not sure that SQL-like languages added on top of NoSQL solutions was really that bad of a thing. It's not as though there's one flavor of SQL to rule them all on RDBMSs. I get that the bones are largely the same - SELECT, FROM, WHERE, most join types, aggregates, etc. But take a really common analytic use case - persisted transactional data. Something like this -

SELECT
A,
B,
C,
FROM SomeTbl
WHERE SomeDate BETWEEN SomeBegin AND SomeEnd
QUALIFY RANK() OVER (PARTITION BY A, B ORDER BY SomeOtherDate DESC) = 1

Pretty sure that SELECT, FROM, WHERE will work just about anywhere. That QUALIFY clause is written for Teradata, and once you get into the ordered analytic functions (as one example), you need to know the implementation relevant to the RDBMS you're dealing with. It's not uncommon for a large enterprise to have MS SQL, DB2, Teradata, Oracle, etc. all under one roof. As a data engineer, you still need to know the differences - first to get the data out, and then to optimize.

Dunno, I could be way off on this, but that's been my experience at least.

I think the bigger issue is that you can use an RDBMS to do NoSQL-like things, such as key-value stores, with the flexibility to structure your data if you need that later. So why not start with a relational database?
Ok, "unix-derivative" if you prefer. FWIW, it actually happened on SunOS or maybe HP-UX, and it was before Linux existed.
There are tables in the kernel git repo if you want a good reference for their values; however, the register definitions aren't provided.

x86: https://github.com/torvalds/linux/blob/master/arch/x86/entry...

x64: https://github.com/torvalds/linux/blob/master/arch/x86/entry...
Utility scale solar makes sense since they usually build it in sunny places, solar panels on your house are great if they will pay themselves off (you live in a sunny place with expensive electricity you get to avoid buying or you get a subsidy) but I think residential battery systems are not currently sensible if you have a grid connection. If the purpose of the battery is for when the power goes out just get a little gas or diesel powered generator.

The article notes the perfect application of solar plus battery; places with no utility connection and the only initial loads will be LED lights and the users will not be accustomed to toasters, air conditioning, etc

"The pledge to provide power could face challenges as it remains difficult to provide electricity in remote towns and villages. The government said it would distribute solar power packs with a battery bank to un-electrified households in such areas."
Access to AI/ML is already very democratic. Takes little time to set run Tensorflow from a docker image, or learn from Jupyter notebooks, etc... with fully open source projects where you can consult the source code and see how an algorithm is implemented.

In contrast this involves running a proprietary operating system, IDE, closed source, etc... Quite the contrary to anything that could be considered democratic.

Then, ML is all about volume. Open a spreadsheet with more than 10000 rows in Excel and see it squirm in pain.
You may want to check out https://github.com/Homebrew/homebrew-bundle which will allow you to do a bunch of that in a single file. https://github.com/mikemcquaid/strap and https://github.com/benbalter/plister may be of interest too.
Is $2.5B enough to do all that?
It was toilets for all last time, right?

Edit: Oh right, thanks for the reminder. https://en.m.wikipedia.org/wiki/Swachh_Bharat_Abhiyan#Histor...
I'm building a Disqus alternative called Remarkbox.

You should add your list to the private beta to join the other active testers.

Check it out here: https://www.remarkbox.com
Freedom, from your Phone
There's a serious category mistake in this analysis.

Germany is not really a separate country. It is a state in a union called the Eurozone, and controlled by a constitution called the Treaty of the European Union.

You cannot compare a currency zone such as the USA to Germany - a state in a currency zone.

Germany drains demand from the rest of the Eurozone to maintain its employment level. The unemployment arises in Greece, Spain, et al instead.

If you look at the near fully employed state areas in the USA and draw a line around them, then compare those with Germany you'll get a better idea.

Within the US there is an 'export boom' from California and New York to the rest of the union. Similarly in the UK from London to the rest of the country.

It's time for economic analysis to catch up with monetary theory. Floating rate currency zones matter.
The thing is ORMs have made writing easy queries easy and hard queries possible since at the very least 2005 with Rails, and they are easily extensible and composable. It's mostly a solved issue. If you want to do complex data manipulation, surprise, it takes a powerful tool. Seems a lot of the hype is the result of VC $ + naiveity/overselling about what MongoDB and co would be capable of. The marketing is natural - MongoDB made databases "easy" and easy is the only way to sell lowest common denominator tech to become a unicorn. Bad incentives for all involved.

Sql is a kind of rite of passage? If you can't learn it or can't be bothered to learn it, you don't need to go anywhere near a database because you can't be bothered to understand the right tool.

Granted, nosql has some uses, but those are few and far between and probably would have been handled more effectively and easily with old approaches like Prevlayer, but Prevlayer was a thousand lines of code and couldn't be monetized.
>So why not start with a relational database?

I asked the same question. The biggest reason I've heard is RDBMS's don't horizontally scale well, meaning you can't easily have 50 replicated nodes across the globe and expect it to perform well, or setup easily, because it's fairly complicated with an RDBMS. There's things like Oracle's grid or SQL's high availability clusters, but they get complicated fast, particularly when you need a bunch of nodes.

Obviously it was a solution for a very large amount of unstructured or semi-structured data that needed to be redundant across networks. With NoSQL, the key/values are a lot simpler to replicate apparantly.

It's a Google/Twitter size problem that most industries wouldn't have, but since it's the new shiny thing, you know how that goes.
>Things might be different now because of the credit CARD act of 2009 which makes it slightly harder to take advantage of younger people

No "might" or "slightly" about it. It's significantly different now. When I was 18 you only needed a faint pulse to get 10s of thousands of dollars in credit. People would hand out credit applications in dorm rooms, at events, in front of classrooms, just anywhere and everywhere you could think of. It was a different time.
You deliberately caused a potential buffer overflow?
Yup, and you move data logic from a stable, baked solution (your RDBMS of choice) to the application layer. Best case, you end up with something as well-implemented as SQL, but you're maintaining it as part of the app logic. Might as well let the database do it.
Make sure you know the definition before you start using it casually as he has!

> Noun. grundle (plural grundles) (US, slang) The area between anus and scrotum in a male or between anus and vulva in a woman. [0]

[0]: https://en.wiktionary.org/wiki/grundle
The following bullet "I missed the Sync between my iDevices. I didn't know that it didn't exist in Mavericks." Holds true for 10.11 at least for Notes. It most likely that other apps don't work either. I have 10.11 & 10.12 installed on my current machine so I have experienced the deprecation(or whatever it is) of the APIs that causes apps to stop working.
Most structured data is relational. If you include data like (someone else's) web site content, images, sound files, video files, etc, it's a different picture (pardon the pun).
It only left in terms of attention from startups I suppose. I also disagree with the reason the article suggested - SQL could not handle the loads. My opinion is that startups simply liked the idea of not having a schema as it fit their agile approach. So, they went NoSQL because it allowed them to get going faster and change easier.
No you can't, you will still get a connection reset error
Palatka stinks. Literally, it smells. Unless they shut the paper factory?
Most AR Stinks – Except This Crazy Sudoku Solver
While an interesting story, this is more of a self-imposed customer screw-up and not quite the same thing, IMO.
(Disclaimers: I don't have much experience using Python to build data science products; potentially silly questions)

In industry, does Pandas tend to power the application layer, or does it find more use as an exploratory data tool?

If the latter, do people prefer to push computation down into OLAP databases for performance reasons?

And if so, what impact will the convergence of libraries and database functionality have on product development? These features strike me as things that you'd find in a database, e.g. query optimizer. I know in the past couple years there have been a couple commercial acquisitions of in-memory execution engines, e.g. Hyper by Tableau.
>> Pretty sure that SELECT, FROM, WHERE will work just about anywhere

Cassandra & CQL is a prime example. CQL become the de facto interface for getting data out of Cassandra, even without the benefits of JOIN's & sets.
sqlite3 is really easy to backup. You can dump out SQL or just copy the .sqlite files.

Scaling it horizontally is where is starts to get tricky.
Thanks. This was brilliant! At first I was annoyed by the interviewer, but she made some great analogs with her comments!
Firefox Memory Usage in the Quantum Era
Cross-Border Data Access Primer
Whose to say it's spare cycles? How does the site know I'm not watching something in a tiny window while doing work?
Thanks. I'm glad some people are getting some use from my posts.

I'm used to the "religious" attacks against me as this isn't the first time it's happened. You need to have a thick skin to post the non-mainstream ideas here. It doesn't matter if you are correct or that your idea is technically accurate, it's all about the how popular the other view is.

The funny thing is how consistent the pattern is. First you see the downvotes and upvotes come in. This is the first sign you're on a hot button topic. Then people will simply tell you that you're wrong without any counter argument. Once you respond back with further facts to back up your argument the attacks on your education/skill/knowledge come in. You misused some cargo cult terminology and that's proof you don't know what you're talking about. Usually it ends there but once in a while someone starts up with the personal insults.

It's funny and sad watching the same thing happen over and over. Sigh.
Does anyone know how dataframe in R compares on these 10/11 points?
How is NoSQL better than simply using the filesystem?
The GFW works both ways. That attack injected code into Chinese browsers viewing sites outside the GFW, but it could just as easily inject code into browsers outside the GFW viewing Chinese sites...
> It's a Google/Twitter size problem that most industries wouldn't have, but since it's the new shiny thing, you know how that goes.

You nailed it on both points. Very few organizations are going to need that kind of scale, but many want to think that they will!

Even when you get to horizontal scaling, you can simply replicate what needs to be replicated. Key-value is really just a subset of relational data, right? If so, I bet we can query and push only that data out across the nodes.

It's not to say non-relational models don't have a place, but they're the exception as far as I'm concerned. I prefer to start with relational and only move off of that if I can justify it. As I said upthread, though, I work in insurance and you might imagine relational works well for us.
Matt Mullenweg
I started in tech at IBM supporting the finance clients. When I moved to an ISP in the early 90s I was dumb struck by the fact that things broke and it was okay. Oh the Usenet server failed again....etc...it never sat well with me. Look SNA was complex, but uptime on the system I support was measured in decades. I have done a ton of startups since then and while I love the speed at which we move the falgility of the system always rubbed me wrong. Looking at the need for speed (mongo, et.al) was always painful. I am happy to see that rational thought is winning (which is how I see this).
Just like anything in the tech world, it all depends on what you are trying to do. There are scenarios where nosql makes more sense and cases where relational databases make more sense. There is no panacea in regards to data storage.
Autopsy of a Startup
So not that I am looking but where do I submit my application to this new division...Actually scratch that: "I am happy to announce my new security consulting firm to aid the SEC Cyber Unit called joshing.io"
As far as I'm aware, AES calculations aren't a component of any cryptocurrency.
How a Satellite Just Used Earth Like a Slingshot
Your views on things are pretty static, China has ups and downs in the river of history, it also had tech flourishing time like in Song dynasty. I guess 40 years ago you would never have a chance to see what China could be now. By the way, Shinhansen also imported a great deal tech from Germany, but what's big deal of it? Why can't China just learn from other countries and build a better and more accessible one? Just like Japan or America did? China now has fully advanced high-speed trains and pushing it to dozens of markets. Including The U.S. You were talking about the policies, those big companies came and made their money without paying taxes, not to mention successfully transferred a lot of polluted industries to China. they got what they deserve. Don't whine about that.
adblock-nocoin-list

https://github.com/hoshsadiq/adblock-nocoin-list/
The SEC is a dept with teeth. I expect the SEC Cyber Unit to catch many an internet scammer, likely to be more effective than regular law enforcement.

This is good news for your average citizen, and bad news for financial criminals.
3D Scene Rendering in Panorama Mode with Depth and Bind Animation Curve Using .NET
I'm not an expert on NoSQL, but based on general computer knowledge I would say some advantages over a filesystem would be:

1. Single entry point.
2. Not having to share your filesystem.
3. Centralized security separated from your OS
4. Simple key/value access (no folder structure)
5. Abstraction of the filesystem (like #2)
6. Distribution of data over multiple nodes.
7. Separation of NoSQL admin and network admins.
8. Shiney new thing :)

I'm sure now a days, an advanced filesystem/sharing protocol would handle some of these.
I'm making my own learning materials for self-studying Chinese.

https://pingtype.github.io

VoiceTube is a similar startup company that scaled this up to help people learn English.

http://www.voicetube.com

I have no idea how to turn my Chinese-learning data into a practical business. I emailed 100 Chinese teachers in universities around Taiwan, but didn't get any replies.

If someone wants to do the business and marketing, I'm happy to give you everything I've done so far.
As someone who helped design, then manage a massive NoSQL store which hundreds of terabytes of data, of which most of it was hot, I’ll humbly disagree and say it’s not necessarily as bad as you make it sound.

Did we have someone who managed that system? Sometimes, but mostly it just did it’s own thing. We ironically invested way more time on our MySQL database over the years because we couldn’t get that to scale the way we wanted to, but I think that was specific to a problem we were having.

Did we later invest a lot of time in that system (the NoSQL one)? Yes, because it was very cost effective for us to do so. At certain scale throwing people at optimization problems can pay huge dividends. But, this can be said of most infrstracture. It’s usually worth revisiting every year or two and seeing how what you can squeeze out.

Did we have churning CPU, infinitely expanding disk, replication issues, and more? Sure, but not very commonly and mostly it was fairly easily resolved. More importantly though, it was a solid system that was the underpinning of a colossal system, and it behaved admiraly more than 99.9% of the time.

Will most projects benefit from a hugely distributed KV store? Nope. But I’m still glad they exist!
Ask HN: Should Mozilla Follow the EFF Out of the W3C?
In order to more fully understand the situation I would like everyone's opinion on why this should or shouldn't happen, and what the potential consequences might be. Thank you.
Outside of a few major metro areas, real estate prices are still tame.
D3 Antminers
China’s security chief calls for use of AI to predict terrorism, social unrest
Why choose an expensive locale like San Francisco for a manufacturing facility?
Are you working from where or who you want to be?
Request for Explanation #11 – Cargo Culting the Build System
SQL is dead. Long live SQL.
It's just some developer who injects coin-hive code on the website he manages hoping to make a quick buck. Executives will never direct to mine from user considering the incredible low ROI. And the dev is HN reader as the coin-hive post was on top some days ago.
All great advice, but realize that you cannot just do one or two of them, or incorrectly execute some of them, and expect to be successful.

For example, you cannot take the 'imperfect MVP' and 'iterate quickly' advice as an excuse for poor testing and ignore the part about a narrow focus or listening to customers. I will admit that I have worked on several projects where something like this was the case.

It may just be that some of the projects I have worked on have not been so great (because it is much easier to get those contracts), or maybe this is common -- but what I have seen is startups or dev teams that are iterating quickly on programs that fundamentally do not work or cause their users great frustration. Part of the problem is that people often underestimate the technical difficulty (or perhaps almost infeasibility in some cases) of certain features or impracticality of some UX, etc.

The user frustration one was a government contract so the users couldn't switch to another program. What happened was we built a program for utility workers that required a ton of data entry in the field. Due to slow loading screens or just a ton of extraneous fields or an issue of keeping laptops clean or something else, it was impractical, so they switched to doing data entry in the office on based on paper forms. And then someone decided to give all of those forms to one poor lady in the office. One day I was permitted to visit, and found that due to some bugs we had not been told about and the sheer volume of work, the lady was literally going insane. They were still iterating quickly and adding tons of features on that project when I left.

Here is an example where a project manager may have been using something like the idea of an imperfect MVP as an incorrect rationale for perhaps not evaluating core functionality carefully enough. The product was a home server device. A core feature that was supposedly complete when I came onto the project was a relay/proxy system that would allow multiple connections to come into this device through one port while it was behind NAT. Or something close to that -- it was a few years ago so I don't remember perfectly. But I was initially given the task of working on some lighting animation and only coincidentally discovered that this proxying system and other core networking was not even close to working. I did eventually get a multiplexing thing working for it but they never delivered the system to the initial customer so it was never fully tested.

On another project, it started out as another case of an 'MVP' that actually didn't do the thing it was supposed to do. It mostly did it most of the time, but due to the nature of the project, without an automatic way to detect and correct the 5% of cases where it didn't work, it could not possibly make any significant amount of money. So when I came on, I wasted quite a bit of time trying to make this supposedly already working MVP work, but it had been 'iterated on quickly' and had unmaintainable code and no tests, so I ended up rewriting it.