skysight-inc/HackerNews huggingface dataset:
You make it sound like many people are using petabyte scale databases. This is not even close to true. ESPECIALLY when you're just starting out. Most new projects will start with almost no data at all and the vast majority of projects will never ever get to the petabyte scales.
By most accounts Oracle V2 was primarily written in PDP-11 assembler. Tom Kyte's suggestion it was written in Fortran contradicts most other sources.

IBM's problem was that they were slow to commercialise the technology despite having a significant head start. IBM built multiple prototype RDBMS systems but they weren't willing to ship the result as a commercial product, and Oracle beat them to it. And even then when they did finally ship, their initial offerings were restricted to their mainframe systems (first VM/CMS and then MVS), while Oracle back then was open to porting their database to just about anything. IBM didn't really come to the cross-platform party until the 1990s, by which time Oracle was well established in that market.

(Disclaimer: Former Oracle employee, although I never worked on the database side of the business, and I'm talking about stuff that happened when I was a kid, or even before I was born.)
Pretty simple things;

テスト*テスト*テスト
テスト_テスト_テスト
テスト[[http://orgmode.org/][テスト]]テスト

Back when I actually have been using org-mode extensively (loved ID based document linking, Calendar file export, etc.) just I couldn't use it for anything that involves Japanese text which was 1/3 of things I had to deal with.
I've actually tried suggesting on a developer's list for possibility of "negative" space where it can denote "space, but not quite space" which wasn't received well..
What is it about this course that makes it so valuable?
No, "all organizations" are not adopting Spark.

All organizations which already have a Hadoop cluster.

You do not need Spark to use dataframes.

Never claimed this. To clarify Spark allows you to directly port Pandas code while leveraging existing Hadoop cluster infrastructure.

And distributed computing is terrible for machine learning.

Distributed computing (Both traditional hadoop/spark and latest TF/PyTorch with parameter server) are essential for scaling ML beyond a certain point.

Maybe you've worked at a job or two where nobody can comprehend not using distributed computing, as you describe, but it's nonsense to claim that "all organizations" work that way.

If you have experience routinely training models on Terabytes of data intended for production deployment. I am happy to hear. There is a vast difference between training a model on your machine for research and building a reliable ML system that scales across large datasets and teams while taking infrastructure costs into account.
Yeah the details are kinda weird (although i wonder if there is some reasoning behind that because Windows also has the same off-by-one-pixel thing - and even more confusingly it is done through the same API call but it is a special case when you use a null pen) but for me the most important thing is that they are there and you can safely rely on that they are there despite the weirdness.
We use pandas as a last-mile library for offline exploration. Typically, datasets have been sampled or aggregated enough that they can fit inside 10gb so you can work with them comfortably using pandas. I don't like using pandas in prod because the performance is really sensitive to stuff like missing a type declaration or calling the wrong method and the API is really convoluted.

E: that's not to say pandas isn't good. It's really good. Thanks for the software, Wes!
My Health Guy (my_healthguy) on Twitter
> damn near impossible for most MySQL users.

MySQL? Nobody, and I mean NOBOBY is saying you should use MySQL. All of the things you mention is trivial using a decent SQL solution like PostgreSQL.
Age Calculator_Basic
> And Tweeter. I never signed up, but from the posts and tweets I've seen, I can't imagine a worse platform for sharing ideas or views.

I firmly believe in the idea that the tools that we shape shape us in turn as we use them. I don't think it's a coincidence that we're seeing an greater upsurge in rancor as social media becomes more entrenched in our day to day lives. If a system rewards people for doing something, you can bet that people will adapt their thought processes to maximize their gains. Nuance is going to be the first thing jettisoned in a short format that rewards instant emotional gratification.
The product we're talking about is Visual Studio Code Tools for AI; "full" Visual Studio IDE isn't even mentioned or shown in the announcement article
Debating ideas is one thing. Thoughts are thoughts. Inviting architects of mass death to speak at your university is another thing. Thinkers and speakers get to pull the academic debate card. You should be able to say whatever the heck you want. But once you’ve got blood on your hands you’ve gotta be judged your actions, not on your ideas.
Except the person to whom I replied said to use traditional SQL databases:

> Traditional SQL databases end up being many times simpler in practice, and because of their inherent scaling limitations, much easier to manage. And most importantly: their implementations aren't buggy.
Why do you think his ideas are morally wrong. In my experience, almost every disagreement that is perceived to be moral is actual factual. That is to say, we have a disagreement on what the consequences of certain actions will be. These disagreements could be deeply rooted in ideology (as in, what is the consequences of wealth inequality), but are factual, nor moral.

Further, by not engaging, you miss the opportunity to present why you think his ideas are wrong. If people hear both sides, they can make an informed choice. If they hear neither side, they can only make an uninformed choice. If you think this arrangement benefits you, I would question how confident you are in your beliefs.
Indeed they do take time. Aren't we (HN in particular and our fellow humans in general) worth it? Figuring out what each other means and why we ourselves are misunderstood makes us better people. Like so many things, that does take effort, and does get easier with practice.
Knuth's realization of the associahedra as (Tamari) lattices
I went to the site and inadvertently discovered that there is a distinct mobile version as well (prepend "m." to the URL).

To steal a line from "Sealab 2021": "It's like a koala is crapping rainbows in my brain!"
But the attackers could have planted the mold as a diversion.
Does that assume free power and cooling?
> 2) "... Parkinson’s Law of Buildings. This he defines as follows; ‘a perfection of planned layout is achieved only by institutions on the point of collapse… Perfection of planning is a symptom of decay. During a period of exciting discovery or progress there is not time to plan the perfect headquarters. The time for that comes later, when all the important work has been done.’" [2]

It seems like this would apply more to Apple's campus than Amazon... but I haven't really seen anyone suggesting that.
This looks great - are you currently working on a python wrapper? If not, I'd be happy to help out there.
Or they could just create a registry flag that enables the backwards compatible behavior. Then all default installs don't have the "bug", while those that need it can enable it.
The conviction for a serious federal offence I think probably flagged him in the DB ... would be a reasonable reason for this. I don't think there's any scandal here.
Thanks for writing this. I was about to write almost that exact thing. It's a weird interpretation of database history with a ton of stuff left out. My best guess is that the author of this article had all the data that would be needed to back this up, but it was stored in Mongo and he couldn't find it when he started writing.
Hasn't that already happened?

Oracle v. Google?
You could probably use something like pandoc (http://pandoc.org/) for the docx. Not sure how well it works though.

Not sure what to do about pptx.
Many people ARE using petabyte scale databases.

They don't start out that way, but they will be if they're successful, and if they're not they probably shouldn't be running their own databases anyway (go RDS it up or something).
As a former mercurial user, it absolutely drives me nuts when people rebase already-pushed commits. I get that this is the norm in a lot of git workflows, but it still makes me twitch!

I prefer to rebase liberally before pushing commits, and then merge once commits have landed in a shared repo or been pulled by others. No git --force necessary.
I really wish they'd let me set Siri to search DuckDuckGo.
World Wide Words
One of the last things I'd want to do is fight with an ORM to build a complex query that doesn't fit the ORM's natural tendencies. A micro-ORM to take care of the boilerplate is great, but otherwise, given the choice between two unpleasant options, I'd rather write 100% of my database interaction code in sprocs than an ORM (promising never to use the raw-SQL escape hatch).
IMO, it's very promising but still extremely immature.

I still believe in Curt Monash's cardinal rule of RDBMS development: http://www.dbms2.com/2013/03/18/dbms-development-marklogic-h...
I don’t understand the lack of reciprocal tariffs introduced by the US or are there some I don’t know of?

This is probably the economic equivalent of banning say mobile phones or some other large and important sector.
The restriction isn't in the filesystem. You can mount an NTFS filesystem on a Linux box, create a file called "aux.c", then mount that filesystem on Windows.

See also: https://news.ycombinator.com/item?id=15335209 and https://news.ycombinator.com/item?id=15335474
How and Why I Built StoryTracker
i want a help for my project.
suppose in indeed.com search bar we will put java,it will so us no of java related job... i need to fetch them and want to store in excel..in different row..
how to do this any idea?? what script can i use except python..
I'm not an R-guru, but I did my thesis with 5k lines of R, so I'd call myself proficent:

Point 10: R has lazy evaluation, which means here that a function will not be evaluated when you define it, it will be evaluated when you call it (maybe not quite the same as some other language's lazy eval). I'm not aware of any built in feature for query planning, if you ask for nrow(some_func(myframe)), it will evaluate the some_func(myframe) function and then count up the rows. You could always write your own query planning function I suppose.

Point 11: R has several multicore/cluster libraries, and some are actually decent. If you are like most R users, you use StackOverflow a lot, and you'll end up with one algorithm that uses the snow package and another algorithm that uses multicore, one that uses parallel, and so on. A few very well written packages have hooks that make going to multiple cores easy, but most do not and you typically have to roll your own.
I mean reach a level at which you decide you don't need the rest of the world, that you're now self-sufficient. They can then take technology in the direction that suits The Party without external influence.
Maybe, but most people want to see that the article (and therefore) there comments will actual get read before investing the time. Combine this with the fact that thoughtless comments simply get written faster, and you have a trend where you get a disproportionate amount of low quality comments at the beginning of a thread's lifecylce, and high quality comments show up later.
Promotional Gifts for Corporate Recognition Programs
While former politicians do get compensated handsomely for giving speeches, I'm not sure about those they give at Universities. I believe those (as well as classes they sometimes teach) are usually part of their philanthropic efforts.

I once attended a lecture by Justice Scalia at my University, and I'm absolutely certain that the University can not legally pay a speaker anything close to the 6-digit sums that someone of his caliber would get on the commercial speakers' circuit. I once sat on a committee that organised such talks, and it took us a year of politics to get approval to invite the XKCD guy, who, unlike the usual academic visitors, charges a fee. Usually, speakers are afforded a stipend to cover their travel expenses only.
​BlueScope Steel: Even Colorbond needs cyber resilience
> In industry, does Pandas tend to power the application layer, or does it find more use as an exploratory data tool?

My experience echos yours, Pandas from my observation, is more like a post-modeling tool, that people use to further process data that they digest from certain DB query or Spark jobs.

After reading through Arrow homepage, I am left somewhat baffled about where it seats. If my reading is correct, it is a client-side protocol that abstracts away the underlying data storage implementations? If so, isn't it still limited by how much data the client machine can handle? Or the benefits is about the unified interface of accessing different storage system? No matter what, it seems pretty ambitious. Looking forward to see how it goes.
I wonder how this will work with apples recent fight against online advertisers. If google does track users but it is all anonymous from the advertisers perspective, does that mean Apple is okay with it?
I think it's not so much the fact of influence, as it was the nature of it.

If, say, RT runs propaganda pieces in favor of candidate X, and against candidate Y, that's fine, because everybody knows that it is Russian propaganda. They can factor that knowledge into their decision making accordingly (and it doesn't need to be negative - e.g. someone who is interested in warmer relations with Russia, for whatever reasons, might actually support the candidates they endorse).

Coincidentally, this is also the kind of involvement that US and other Western countries normally practice overseas. E.g. looking back at the Ukrainian revolution in 2014, it was very obvious and transparent which side was backed by the US government.

In contrast, what we've seen in this past election is covert foreign propaganda, that tries to actively conceal and misrepresent its identity (many of those fake FB accounts and groups pretended to be American). Not only there are obvious ethical issues aside, but - in US, at least - it also runs afoul of the Foreign Agents Registration Act, which is a law that has been around for almost 80 years now. So you can hardly say that it's some new thing.

Then there's also the orthogonal aspect where a lot of that propaganda is blatantly false to an unusual degree. We're not talking about spin here, but actually manufacturing entire news stories around events that never happened, and facts that were never true.
If your university has requirements around formatting (most do), then you'll likely spend many hours making anything that isn't LaTeX (or, blech, Word) do the right thing. For a thesis, your best case is to just use a university provided LaTeX template and then spend as little time bike shedding as humanly possible.
Absolutely. Even a bigint / long sequence column so often feels a bit ridiculous.
The scandal to me (unrelated to Chelsea directly) is that Canada CBP has higher level access in the US NCIC than most domestic law enforcement agencies.
PeerJS simplifies WebRTC
So unless their ideas end up working perfectly in practice, we should close our ears to anyone who has practical experience?
Sure. I'm having a hard time figuring out what you see as a good way forward for HN should be if the goal is to have substantial, constructive discussion. Or at minimum, civil discussion. The low quality, incendiary comments degrade discussion and can deter those who would otherwise engage in quality discussion.

Edit to add: What's motivating me continuing this discussion is that I feel like you're pushing back on encouraging people from doing better, from improving how they engage with others. I'm not sure if that's really what you intend, so please do elaborate on that point. Clearly this is important to me, so I appreciate that you're taking the time. (Though, with that, I'm signing off fir the night. It's late :)
Iron Yard was successful in one rural area, and decided to simultaneously open up 16 new spaces at once. Turns out that's like building 16 separate companies simultaneously.
Hi, Wes here. R data frames have limited to no query planning and are not multithreaded in general, so Problems 10 and 11 are problems in R also.
> but I think it could end up being a gray line.

The SEC can and does monitor social media, correlate it to trade data, and takes action based on that data.

http://nypost.com/2017/09/07/ex-amazon-employee-pleads-guilt...

Credit to Matt Levine's Money Stuff Bloomberg article where I originally read about this, but cannot find the article with a bit of Google searching.
One criticism of having a centralized national police force, a common feature in developing countries, is it makes corruption easier and more attractive. In a sense you’ve also centralized corruption and given it just as many efficiencies. That being said I don’t have a full solution to this issue, just a quick point from the other side.

EDIT: I think a while ago (2-3 years maybe) it came out that the EPA had their own SWAT team, which seemed pretty funny.
Training New Real Estate Agents
This website makes it easy to view thousands of properties, quickly and review all associated reports. Search our Area Listings or our Kanam Realty Group Featured Properties section to get a start on your real estate investment. Our agents specialize in helping you Buy, Sell, Invest, Lease & Manage residential & commericial properties in the communities of Dallas/Fort-Worth, Austin& Houston.
we're due to add a "Powered By" page to the website, the list of users is growing pretty quickly (e.g. Spark has Arrow support now)
Yeah I noticed when looking at the TypeScript compiler itself that the names are ridiculously long. Probably because they edit them in an IDE like VS Code.

Does TypeScript minify your code or is that a separate step?
Lots of bootcamps with multiple facilities do very well, but that makes costs high, so if you make a few missteps it's game over.

Most are clearing millions in profit.
I could almost see Apple buying DuckDuckGo, given that a) Apple cares about their users' privacy, and b) Apple cares about having control over the entire user experience. DuckDuckGo would fit right in with both of those core pieces of Apple (no pun intended).

I don't think it'll actually happen, but it doesn't seem too far-fetched.
It's not even two years old and doesn't have a 1.0 release. It wouldn't be smart for "major" projects to be using it.

There are probably folks using it for exploration but probably not a production system.
Or watching full-screen while a script does the work.
Some of the resurgence of sql has to be the size of data you could fit on a single machine / fake with a distributed system increased.

But postgres I think continues to be at the forefront: first, the article misstated slightly; jsonb gives you not only full text search (who needs that?) but indexing all the way down. So you can eg say I want records where "field1 -> field2 has an element named md5 with a given value...". It turns out that a lot of plain normalized tabular data plus a medium about of schema-free jsonb really is the perfect combination for most purposes.
But it could have just as easily been a windows batch file, it's not related to the OS at all.
I generally agree with you, but:

applying the slightest bit of empathy, you'd immediately realize that the questioner simply didn't know the history of the test image (the original uncropped image was from playboy).

You are implicitly agreeing that with the idea that naked pictures of women are fundamentally crass, tasteless, openly hostile and disrespectful to women. I think this is not really a good thing to do, though I realize it is politically correct and the safe route.

I'm female and occasionally rant about how fashionable misandry (or the demonization of anything hetero male) has become, a la: http://micheleincalifornia.blogspot.com/2014/11/having-sad.h...

I have a lame hypothesis that if a woman makes such comments, maybe people will see the logic. Experience seems to not support that hypothesis. Haters keep on hating anyway. Sigh.
Wes here. From what I understand, pandas is the middleware layer powering about 90% (if not more) of analytical applications in Python. It is what people use for data ingest, data prep, and feature engineering for machine learning models.

The existence of other database systems that perform equivalent tasks isn't useful if they are not accessible to Python programmers with a convenient API.
Chromebooks are tiny. Smaller than linux even. It's just MS and apple.
The problem is that SQL (in all its forms) has not been relational. Nor is it complete in terms of its querying ability. This means that it can do unexpected things and more so when you have nulls included in your data.

The Third Manifesto (by Date and Darwen) highlight many of the problems of SQL and SQL DBMS. Though I find TTM to be lacking in various ways, it does, at least, start heading in the right direction in terms of a database query system.

Over the course of decades, I have written much SQL and have had to modify and document many systems that were based on SQL DBMS's. The language is a PITA, but you do what you have to do to get things working.

NoSQL was, to me, a retrograde step, though it has some usefulness in some situations. What I have found is that most databases have not been designed with regard to Relational Database Theory (RDT). In general, the attitude that I have observed has been that RDT is good in theory but bad in practice.

I have built (using mickey mouse systems), fairly complex, multiuser databases based on RDT. I have also seen many databases built (using ORACLE and SQL Server as the DBMS) that have not used RDT and they have been atrocious. One such system, built by some SQL guru, took 25 hours to do a run of one process. Had it been built according to RDT, the entire process (by my estimate) would have taken less than 20 minutes to run.

When designing any kind of database using any of the various technologies that have been developed over the 60 odd years, there are various design principles that will allow a good database (fit for purpose) to be built. It appears in many cases that none of these principles are known or if know are know then not adhered to.

Of course, what others might have found can be quite different.
That wouldn't make any sense given that DDG is thin UX veneer around Bing, and it doesn't maintain its own index.
Yep. I'd recommend the xkcd[0] approach with Diceware[1].

[0]: https://xkcd.com/936/

[1]: http://world.std.com/~reinhold/diceware.html
But why is it that when Russia engages in covert foreign propaganda, it's bad, but when the US does it it's normal or expected and no one complains? Are you suggesting the US and other countries don't use blatantly, knowingly false propaganda as well?

Of course, from a political standpoint Russia's government needs to be penalized by the US's government. And of course, if there's any evidence of collusion between US politicians and the Russian government, that needs to be investigated.

But why should Russia's government be viewed as particularly monstrous for doing what the US and probably dozens of other nations do?

The actual monstrous stuff is the allegations of Putin murdering journalists and oppressing political enemies, though of course there's no smoking gun for many of those allegations (or at least the murder ones).