skysight-inc/HackerNews huggingface dataset:
My first idea would be the following:

If I had enough time for the problem I would first use a morphological and syntactical analyzer to try (at least with a high probability) to determine the morphological structure of the words and I would tag them with their syntactical category (part of speech). So I would treat for example 'work' and 'worked' as being the same word. On the other hand I would treat 'can:aux' and 'can:noun' as different words.

Now I would completely eliminate all the words which are not nouns not adjectives and not verbs. (the, a, can:aux, may, etc...) These are 'asemantical' words.

Maybe eliminate extremely rare words also (with 1 or 2 occurences)

After this preprocessing now comes the semantical relatedness analysis.

A very primitive solution:

----

Compute the ten best B for A where the following is maximal:

f(AB) / (f(A) * f(B))

f can be the frequency. f(AB) can be the frequency of occuring together in a document or within a distance (like 5 words). But you can fine tune it: weight it with the actual distance.

You don't have to maintain the full matrix. As you go through the documents just maintain max 100 words for each word for which this measure is maximal, and in the end just take the 10 maximal from the 100.

----

A more sophisticated solution for the semantically relatedness analysis:

Let's put all the possible words into a 2 dimensional map with totally random x,y coordinates. Now as you go through the documents imagine that the words which occur near each other attract each other on the map so their distance is made *=0.8. They gravitate. Imagine that the mass of the word is its frequency: the distance is made smaller by small frequency words going towards the big frequency word a lot, and the a big frequency word goes just a litle bit. Just like gravitation. Of course time to time we change the scale: we blow the whole map up a bit to not make everything gravitate into one point. This algorithm is a 'global algorithm' in the sense that it takes into account indirect things like synonims which are semantically really related even though they not really occur in the same sentence. In the end determining the 10 nearest neighbours fast is easy: you can use a simple grid as 'space partitioning'.

Edit: A 2 dimensional map s not necessarily optimal, it might be too tight. I would also experiment with setting the map dimension to 3,4,5 etc...
Other databases do not have this problem, MySQL is just a particularly bad example of a RDBMS
Scale just breaks MySQL.
Your second point, I think, too easily dismisses the fears men have.

Lacking evidence which suggests the guilty party, we are left to our own natural sympathies. Women may have more sympathy for the narrative of a woman assaulted, men may identify more with the story of a man falsely accused.

These are both perfectly natural responses, as long as we recognize our personal biases, and can accept evidence which contradicts them when it becomes available. I can't see how it is productive to undermine either point of view: they are both legitimate emotional responses.
Alphabetical, respecting namespace:

System.File.Open
System.File.Write
System.Net.WebRequest

So naturally, you get like things grouped together. Assuming your language has a sane library, your concern shouldn't be an issue.

Of course, if your "library" consists of 4000 functions named things like "mysql_get_connect" and "DateFormatUTC", then yes, you're screwed.
Jon Oxer (http://news.ycombinator.com/user?id=jonoxer) has and was working on a TV show about it (http://www.superhouse.tv/).

He's documented some of it on his blog: http://jon.oxer.com.au/blog/category/DIY

(I thought he had documented more but I can't find it. :) )
MIDI is going to mean the iPad, with its touch interface, is going to be an excellent platform for soft synths and effects/DSP apps .. meaning less and less mousing around and a lot more intuitive performance in this, traditionally ultra-boring, realm.
Wayland was started by someone at Red Hat.
I'm not disgusted. The irony is that the essayist seems to be assuming all men are sex-hungry primitives, and 'keeping score' is exactly the sort of thing that makes male chauvinists so annoying. Although her points are completely legitimate, they're obscured by the generalizations and condescending tone.
they are both legitimate emotional responses

... and people of both sexes should strive to feel both responses, instead of reacting solely from the perspective that comes naturally to them.
The second one is way more fun, using the real device as the plaintext and the loopback as the cyphered version.

Have you tried using the -C (compression) option to ssh instead of the bzip2 pipe? I don't often have occasion to do this sort of thing, so if you've tried that already, it would be interesting to know relative timing. pbzip2 ( compression.ca/pbzip2/ ) might be helpful sometimes, but I don't suspect that it's carried on most live CDs (unless you guys are rolling your own) and the CPU probably isn't the bottleneck anyway.

9P2000 has recently made it into the Linux kernel and it gets way better throughput than NFS, but (and I'm not too familiar with NAS hardware or software, so I may be saying something foolish) I don't suspect it's a supported protocol on those things. Either way, I also don't suspect that adding the overhead of an FS protocol could be helpful in cases where netcat would do, but it's a nice tool to have in the box.
Nike Air Force 1 Low Marina Blue White Birch
Of course, once I buy that product, it becomes my product. My possession. My asset. And I would condone modification of my product.
also, the example from here http://www.extractiv.com/tour-semantic-on-demand.html does not work.

I second, this seems interesting (and I would be really interested in seeing what you produce as "relations")
Free Giveaway and Stuff
People who wants to giveaway stuff for free which they no longer need or get what they need and don't have can give it away or donate at online.
That Document structure stores a URL and its pagerank for later processing.

In the Sawzall paper, it's used in a program that reports the top URL from a domain, ranked by pagerank:

proto "document.proto"
max_pagerank_url:
table maximum(1) [domain: string] of url: string
weight pagerank: int;

doc: Document = input;
emit max_pagerank_url[domain(doc.url)] <- doc.url
weight doc.pagerank;
Don't worry about your competitors. Focus on your product.

Big players move slowly. Most of the times it is easier, faster, and more profitable to buy the startup instead of building their own product to "compete".

E.g., Google could have built something similar to adMob, yet it decided to buy it.
Reverse engineering is educational, thus... Er. Uh. :)
I want an app that will send me an email when a band I like releases a new album. Maybe take my favorite artists from my Last.fm profile, and make money by referring album sales to Amazon.
I'm really disappointed in Andrew disseminating this bullshit. It hurts the reputation of your site badly. As an iPhone developer I can guarantee that ads cannot deliver that much revenue for the stats shown on iTunes. People, please don't waste your time with this ebook scam.
Just for the record, there were some synths with XLR MIDI connectors in the beginning of the 80s, for instance the rare Octave Plateau Voyetra 8.
How To Boost Your Traffic With 6 Simple Techniques
1: A "How-to" post
Articles with the words "how-to" in their headlines

attract people like magnets.

2: Come up with a list( see Del.icio.us hotlist

page)

3: Do you number your list for best results?
List that include a number in tyhem are very

popular. Readers bookmark them readily.

4: Get humorous

5: Inspirational and motivational messages

6: Write outrageous but truthful claims and boost

your traffic

Grab For Free My 5 Day Crash Course !
http://www.freebloggingblueprint.com
I think the most beneficial thing would to be blunt with a person, tell them exactly where you think they have gone wrong. They may disagree but in the end pg is the one with the yc program to offer and gets to make the call, rightly or wrongly in heinsight who makes the cut.

I don't think tiptoeing around it really helps either side.
"10 000 hours rule" & "talent is overrated" explain that you do not need to be a genius to achieve great things, your dreams.

Man, you are so young! Life is so ahead of you.

It is a great competitive edge when we accept and acknowledge we often are weak. Most people bullshit themselves. To be honest with yourself like you are is a great solid start. The awareness of your greatest weakness may become your greatest strength.
> Microsoft pays some of the best in the world.

Some of the best. And most of the best are "out there" and not on their payroll. Plus it's not impossible that some of these supposed best on their payroll may also contribute, on the side, to helping hack/crack their products, anonymously. Regardless though, I bet for every 1 world-class hacker inside Microsoft there are 100+ outside of it, and some of the latter will have the interest and time and skills to hack it.
How to Call an Autonomous Taxi using an iPad
Great work, thank you. Can you list the availability of the original domain (example.com) as well?
So why is X10 a joke?
No, wearing a mask can cause you to be more confident. It's not a guarantee.
Onida G565 1.3 Megapixel Phone Features & Specifications
Onida G565 mobile phone comes with Dual SIM Features GSM+GSM quad-band. Onida G565 Phone has a display of 2-inch LCD screen. Onida G565 comes with 1.3 Mega Pixels Camera with Motion Sensor and digital zoom feature. Onida G565 camera resolution is 1280x1024 Pixels. Onida G565 is available in Red with Black color. Onida G565 price in India : Rs. 2800 (Aprox). Onida G565 Features & Specifications:
In a previous rented place I had a Misterhouse rig hooked up to some X10, Ethernet throughout the house and several MythTV servers so people could watch TV in different rooms. Then some people moved out, non-geeky people moved in who would routinely break stuff and I ended up with just me and my flatmate having hackery stuff going on in our rooms and some in the living room.

As the lock on my room was a bit crappy I had an SGI Indy with an Indycam pointed at the door taking photos every few seconds, and a script on a FreeBSD box that would check for differences, notify me of any changes (this was before I knew about ZoneAlarm) and string the differing ones into a gif with a timestamp. I caught a flatmate going into my room a few times to 'borrow' some things without telling me.

In my current house we've had the mythtv setup going but have moved to a Mac Mini downstairs with EyeTV. The house is a bit too small to justify X10 everywhere, and I have too many other DIY tasks I'm trying to avoid to be able to get away with putting it in :)

I do have a wireless electricty usage meter though, haven't quite figured out how to log the stats yet.
Ask HN: Largest known MSSQL installation?
Having read the great article on MySQL at Facebook, I wonder how MSSQL performs in the wild. At my dayjob that's the one component I cannot get my employer to consider FOSS.

Does anyone know the througput of the largest MSSQL installation? When I search the web, I can't find anything that compares to the MySQL article. Maybe that's because banks and insurers don't like to disclose this kind of information.

But I keep wondering if those businesses even have the same throughput as Facebook.
Bookmark for all
Should have called it How To Write a "Learn X the Hard Way" the Hard Way

EDIT: Change "How" to "Learn"
Relational databases have as much or as little schema as you like and the article did point that out. NoSQL varies widely in terms of approaches to schema so I don't think a blanket statement about NoSQL schema evolution is even possible.

The issue I see is that moving the kinds of guarantees that schemas provide into application code doesn't necessarily make the system as a whole more flexible or easier to modify. The exact opposite could be the case.

Postgres has a very liberal license as well by the way.
I think that the data model of some new database is more suitable for different use cases compared to relational DBs.

Also it's not just a matter of scalability: latency is a very important constraint.

Finally I see a lot of small sites, forums, blogs, that can't scale easily to small numbers using relational DBs, since with the relational model and current implementation you have the illusion that can design a few table and then invent your queries, and instead this does not work and is dramatically slow.

No need to have very large numbers to see how hard traditional DBs sucked. And the proof is the huge adoption of NoSQL in small companies: it's not just hype, people want to go home and sleep well and will not trow away working SQL solutions because there is the new hype. The reality is that they are experiencing serious problems even at the scale a small and mid-size company operates.
Can you remark on how much these things cost you, all said and done?
My weekend hacking on IP cameras turned into a startup: Dropcam (http://www.dropcam.com). Dropcams can push alert your iPhone on motion or sound and they store up to 30 days of video.

When I was a kid, I had the Firecracker serial-to-wireless-to-X10 gadget hooked up to a PC running Microsoft Agent/batch scripts. I could voice control my ceiling fan, lights, etc like Star Trek (at least, if the Enterprise had ceiling fans). It was a big hit with the ladies.

I like everything about renting except for how much of a hassle it is to change wiring and put gadgets in the walls.
I wouldn't say rich or famous, but in certain niches in niches I've been well known.

I sometimes meet people at events (particularly in the UK) where people know who I am before I've met them, this used to lead to embarrassing situations where I'd try to work out if I'd met them before, but these days I'm used to it.

I have some friends that are quite rich and it seems quite stressful, in terms of the keeping up appearances aspect and social pressures, but a lot of that is to do with the culture in that country. When they come over to the UK all that evaporates and they can chill out with slobs like us :)
I did it just today. Ooops, I just did it a few seconds ago again. ;)
This is clearly spam...
Whether it saves time or not depends on a lot of things. If users actually determine the structure of your data then you're right. If it's just about schema evolution by developers I don't think that moving schema constraints into procedural code makes things simpler or more flexible.
There's not a lot of info in here, but it'd be interesting to see how Symantec came at this number of people.
I hadn't realized until really recently that it had accumulated this buzzwordy usage, so I used to assume the person writing just wasn't very good at English and had misunderstood the connotations of the phrase.

Unless I've been completely wrong about its meaning for years, "reach out to" implies more of a process, rather than simply asking a question. If you say you plan to "reach out to the city's troubled youth", people would assume you meant something more than just asking some troubled youth a few questions.

In this case, I don't see what's wrong with saying: we asked Google why Gmail has been slow, and this was their response. "Reached out ... with the following statement" feels sorta like an oxymoron.
ALL. We should all contact the Apple App team to alert them of the obvious fictitious revenue reporting by Thinking Drone LLC and the way they are trying to profit from this. Apple will not tolerate this. You can email support@apple.com and appreview@apple.com
Arc 3.1 works with the current version http://arclanguage.org/item?id=10254
Namespacing is nice but not sufficient.

What you want are examples sorted by usage.

An object, function, etc, can only be in exactly one namespace. e.g. "File" or "Net", but not both. What if a class can be used to accomplish multiple goals? The example code will end up in some obscure corner of your deeply-linked language reference pages.

No... a single .html file that contains all examples in all categories (or namespaces in your case) is much more useful than any alphabetical reference.

Note that the single examples.html page does not try to provide a reference. It provides example code, and that's it. No noise.
Sounds like they're 90% done. So this means only the other 90% to go! :)
You should check out Andy Stanford Clark from IBM - afaik he uses MQ technologies hooked up to various sensors to control and monitor much of his 16th century house on the Isle of Wight (UK)- http://www.bbc.co.uk/blogs/technology/2009/06/things_that_tw...
Your brain may be set up completely differently from mine, so would they be compatible?

That's my point.. to even ponder whether or not we have the same idea in our heads, there has to be some objective form of the thought that is compatible with both of our brains. Then, assuming there was some miraculous way to get the thought into my head, I could compare it with my own thought to see if they match.

If, however, brains are structurally unique to the point that thoughts are meaningless outside of the context of the particular brain that thinks them, then why is it interesting to ponder if our thoughts are the same or different? Of course they are different since the notion of their sameness is a non-sequitur.

The notion that we use the former type of thoughts to think about colors, and that they are interchangeable -- that I could see red in the same way that you see green, while seeing actual green as something else -- is conceivable, but completely unnecessary to explain anything about the mind. You can simply remove that step and get a simpler and equally adequate theory to explain color vision, so why would we even contemplate the step existing?
Jesus christ. Don't these people learn anything: stop telling us how close you are, it's like death by a thousand papercuts. Just give us the news.
You left out a word - 'related'. Consider:

Tennis Playpen

Semantically related yes, meaningful no.
Yes, technocally, it would be like that. Sociologically, however, things would be quite different; Apple's users did not have zillions of X applications that they already used.
Ok got it, I've improved the text in the meantime, you might take a look, and yes the testimonials are real, thanks.
I doubt that any DB that stores data physically in a row oriented format doesn't have issues with this particular type of change. But of course there are many other ways to work around that. For instance, you could just create a new table and a view to join the two. Or, if a particular table changes all the time, redesign it to store key value pairs instead. RDBMS can easily be used in a schemaless fashion if needed for particular scenarios.
Isn't the Demand Media world, an outcome of the inherent shortcomings of the Google search engine? -- There will be people to exploit every loophole in any system.

In mid-late 90s (for all non-google search engines) you had the problem of link stuffing. Now its SEO!

Wonder, if the success of Adwords, and lack of real competition, is holding back Google from innovating fast enough in search technology.

That's why we need some real competition in search. And fast. Will it come for Blekko, Bing or Facebook?
Mike Rowe of Dirty Jobs got to drive the crawler in one episode. It was a cool episode. You appreciate just how big it is when you see him standing next to the treads.
The author is not trying to convey that he never worked hard. Believe it or not, you can both work hard and enjoy it. The author is trying to say he enjoyed his work so it never felt like work, therefore it just flowed.
This is a change to the script. Now implemented in bash. Also, raises only windows in the current workspace. http://punchagan.muse-amuse.in/blog/raise-windows-on-current...
We should be careful about words here. Invention, innovation and creation are all different things.

Linux and git are both innovations, as they made known concepts (Unix kernel, DVCS) useable by the masses. They are hardly inventions, because they did not present new ideas or concepts. If they are creations ist debatable. Linus himself says Linux has "evolved", which means there is no specific creator, hence no creation. On the other hand git is (initially) completely created by Linus.
Offtopic: interestingly, PG's requests in "What would be your dream setup?" were actually realized by Apple.
Right, these guys are scamming us all. It is impossible.
There was at least one person on the thread for the original blog post that argued that the incident as described did not constitute sexual assault, and when the actual statutes demonstrating that it was were given to him, he said basically that while it may be sexual assault in the letter of the law, he did not think it was that a big a deal or that what was described should be illegal. He received plenty of downvotes, but plenty of upvotes too.

I know that arguing that something should not be illegal is not strictly the same as arguing that it's not 'not okay', but it is close enough to make me uncomfortable.
Refactoring: You're Doing it Wrong
Direct link: http://www.cultofmac.com/how-apple-almost-got-microsofts-kin...
If not pressing libel charges makes you suspicious, doesn't not pressing sexual assault charges make you suspicious too?

If I were the guy and not guilty, I wouldn't really be all too interested in pressing charges, mostly because I'm too lazy and I hate lawyers etc.

EDIT: Now that I think of it, actually I would probably end pressing charges, but my initial reaction would be that of "wtf, why do I have to summon lawyers because someone did something stupid", with emphasis on the wtf.
Uhm, where did she say that? I think your allegation deserves an exact citation.
Ask HN: Would you please give me some feedback on my new startup?
A couple of days ago, I submitted my startup for review http://news.ycombinator.com/item?id=1855901 but haven't got as much feedback as I expected, I've made some additional improvements and I'm officially launching the product now, it's mobile site creation tool for dynamic sites (mostly for blogs), we help peoples create and monetize mobile versions of their websites in less than 2 minutes.At this point, we don't support static/flash sites but have it on the roadmap.Please take a look and feel free to share your feedback and suggestions here. Thanks

The site url is: http://www.gmbhnews.net and the mobile sites are hosted at http://www.gmbhnews.com
Ah, looks like we were talking past eachother. You were saying that you preferred "cookbook" style books, and gave examples of how to organize one of them. I was saying I liked "language reference" style books, and gave examples of how that should be organized.

Sorry for the misunderstanding.
I think it can definitively be said that if you kiss a girl and she shoves you off and tells you she's not interested that she's not 'up for it'.
> Schlepping files between computers.

What about using rsync instead ?
Henge Docks: a MacBook docking station
Great analysis. You are absolutely right.
30000 litres is the same as 30 cubic metres, i.e. "small swimming pool". Easy.
But why do scientist should care who wins. Natural laws/evolution will decide the winner. After all everything is governed by rules of nature, and scientist is theoretically just supposed to observe it.
What a scam.
"and elance confirmed that."
Of course they outsourced everything, how else would they make the apps? The point is, they are using the proof of the apps to tell their "get rich" story, which is all clearly a lie.
In case you're interested, here are other reports of the same story:

http://news.ycombinator.com/item?id=1869772

http://news.ycombinator.com/item?id=1870798

http://news.ycombinator.com/item?id=1871276

http://news.ycombinator.com/item?id=1872308

http://news.ycombinator.com/item?id=1875650

None of the submissions have any comments ...