skysight-inc/HackerNews huggingface dataset:
The not so obvious difference in the Tgres approach, and my blogs might not be doing a great job of explaining it, is that some time in Feb 2017 I significantly revamped the storage approach to what I dubbed "vertical" storage whereby a timeslot stores an array of points in which every array element represents an element of a(nother) series.

So it went from:

series1, array[val1, val2, val3 ...] --> time direction
series2, array[val1, val2, val3 ...]
...

to

slot1, array[series1_val1, series2_val1, ...] |
slot2, array[series1_val2, series2_val2, ...] |
^ time dir

With this structure you can write a single row and insert data points for n series (where n is array length) in a single row insert.

Thus, if I have 10,000 series, and my arrays are 1000-long, I can insert a data point for each of the 10K series in only 10 row inserts. This only works if the data points for all series for the same slot arrive at approximately same time, which in a monitoring-like scenario they usually do, but in other situations might not be the case.

The flip side of this approach is that querying the data then becomes less efficient because to read one data point of a series you end up reading an array-length of data points you might not care about for this particular query.

Also, tgres takes the round-robin approach, versus the timed partition approach and that's completely apples and oranges when it comes to performance. The round-robin approach also works only if the data points are evenly spaced (or transformed to be evenly spaced on the fly, which is what tgres Go code does), and again, it's hard to judge whether that's fundamentally "good" or "bad".

I can see how readers of this thread my be looking for which technique is faster, but it's just not that simple, and very much depends on the what the actual requirements are. The round-robin versus timed partition is also not mutually exclusive, you can combine the two, which may or may not be faster, not sure, the devil is in the details.
See N Tell [1] - A web-based sentence construction game to help 5-10 year-olds to learn words via images from Google Image Search. Earnings: 0

[1]: https://seentell.me
Assuming I understand the paper correctly....

1. The DNA is sequenced.
2. Sequence data are compressed with a version of fqzcomp which has been modified to use/overflow a static buffer.
3. Something about this particular DNA sequence overflows a buffer in fqzcomp
4. The overflow contains some kind of exploit.

The paper is a little vague about where they inserted the exploit into fzcomp(https://fqzcomp.sourceforge.io/), but it does process the DNA sequence a block at a time. It tracks the frequency distribution of nucleotides so it can model them for compression. I hope the exploit was something really clever, like finding a DNA sequence that puts the encoder in a weird state, but it's also possible they just set BLK_SIZE to 1 or something like that.
I think roughly 55 minutes is what it took, so I think about 30-35 minutes after you posted. I can't be exactly sure
I think with this administration it's more extreme than before. It seems only millionaires, business people or lobbyists are allowed to the table. Scientists and other experts are being treated in a hostile way.
Regexp could still work by only hashing the domain name and keeping the regexp separate.
They never forgot why they were there, it's just that the reason (self enrichment, both financially and in terms of power) isn't the one US citizens believe it's supposed to be.
You seem to assume that preference is one sided. I can understand that you might not think it is a problem. What I can't understand how you think (if that is what you think) that the condition are the same. Even in your scenario men don't have to overcome "self-discrimination" to become interested in computers, women do. And they have to do so at a time in their lives where most people, maybe geeks especially, are insecure about themselves. And even if we assume that it is only women, and not men, who suffered from this "self-discrimination" we don't really do a good job of letting them correct it later. Instead people insist on focusing on "hacker culture", "having coded since you were young" and "being the right kind of computer geek" long after finishing high school.
The user was correct in my case, stereotype or not.
How do you think that relates to the issue of the strong systemic biases that my comment concerned? I don't see any particular connection.

I suppose you might say that freely discussing certain topics might bring this effect into play. That would be a downside. But as with everything there are certain positives and certain negatives. The question is what is the balance of these for a given option (suppress/not-suppress).

In my comment I was saying that I'm deeply sceptical that the balance of suppressing certain talk brings you out on top. Pointing out a single benefit (avoiding that effect) doesn't really tell us anything concerning the answer to that larger question.
I believe that treating everyone as individuals, rather than as tribal groups, is the only way forward. You don't have to get to know someone at a deep level to make a hiring decision.

What ever happened to the notion of being color-blind when it comes to policy enforcement? AKA, actually treating people equally, based on merit?

What exactly is wrong with "blind-hiring," rather than "diversity-conscious" hiring? It worked to remove the gender gap in orchestras. Why wouldn't it be good to use in tech?

http://gap.hks.harvard.edu/orchestrating-impartiality-impact...
Simulate the human brain with Machine Learning (No ML experience necessary)
I just saw this, thank you for the super encouraging reply! While I've never been poor, I come from a place where the thinking is very narrow and I've been super lucky to get out and have a chance at living on my own terms.

Your idea of starting an online diary is also very interesting - I'll definitely consider doing everything in public. I'm just a bit paranoid about putting my (sometimes opinionated) thoughts out there for future employers to see. Maybe it can be a strictly advice, wins and losses.
> I'm simply a good support player.

Ding! That's what we are, we're like outfielders in Baseball. You need great pitchers and catchers buy it's hard to win a game without good outfielders.
How would that work though? DMCA only applies to the US, so with a global network how would the DMCA be effective? Even if every node in the network in the US removes it, all you might achieve is break the chain. The content will still be there.
Nah, it's just a token opinion column, they do it all the time. The rest of the paper is still unabashedly pro-Left
I'm not aware of any such thing.
> citizen impact per employee.

Do you think it would actually possible to quantify this in a way that:

1. Accurately represented "reality"?

2. Couldn't/wouldn't be gamed?

Seems challenging to me.
What makes you think it was?
I think we've strayed too far off topic here. Since you've confirmed we're not talking about James Damore or even "the alt-right", I'm pretty sure nothing we're discussing is on-topic anymore.
So we should be adding functionalClam.com on our own? Perhaps all of these.
How so? Times is browser default and was easier to read than a monospaced font.
It is a numbers station. It's been known for years as the article says, and referred to as a (one of the many) numbers stations. Many/most don't actually read numbers.
> Regarding native storage, the insert rate really goes down as your table gets large, e.g., Timescale gets 20x higher throughput than PG: https://blog.timescale.com/timescaledb-vs-6a696248104e

I actually looked at this benchmark briefly, but couldn't find what kind of PostgreSQL schema you used there.
Did you use similar array based schema as was described by Tgress author in his post? https://grisha.org/blog/2015/09/23/storing-time-series-in-po...
While I agree, I think brook's argument is even more easily dismissable as the BS it is. One of several reasons for citing material on which an argument is based is to trace the flow of knowledge and tie statements to the prior research they interpret.

James fundamentally misinterpreted much of the research he cited in ways that are overly summative to make a point he wanted to make. He sought research to give his biases the veneer of science without understanding what the authors of the underlying research meant.

This whole incident, from the very beginning, represents one of the major problems with public understanding of science. There are basic ontological misconceptions about the relationship of researchers and research, about the generalizability of most scientific research, AND about how scientists within a field interpret and infer from results...and how future scientists build on that work. Because so much of that thinking work is invisible to the naked eye or is lost in media depictions, people think they have a greater understanding of how science constructs knowledge and they feel excessively qualified to infer and extrapolate research beyond what original authors had intended.

As you note, when science is discussed through means, when people attempt to decontextualize science, and try and simply apply science as a post-hoc rationalization for their fears and biases they are the problem not the science and not those who call BS on bad uses of science.
> Interest is not the same as ability.

I'll make a subtle point in a discussion that clearly can't handle the subtleties it already has.

Interest is not the same thing as ability, but interest is a great indicator of ability in technology, especially fast moving technology. In fact, I know plenty of people who are underemployed or underpaid that I say, "You, know, with your skills, you'd be great at writing software. Maybe you should develop an interest in coding." Similarly, people ask me, "How do I get a job in software?" and I suggest something very basic (tryruby.org, say) as a way for them to quickly figure out if they are interested. If they don't like problem solving and coding, they might be able to force themselves into qualifying for a job, but I'm not sure that's a good career strategy.

Point being, to some degree, interest is one key component of ability in software and some other kinds of technology work.
Exactly. No one's worried that we have too few female coal miners or garbage collectors. These are physically demanding, not prestigious and often low-paying jobs.

Hell, no one's worried that we have too few female oil rig workers and these ARE (in my understanding) high paying jobs.

But STEM? That's somehow different.
My advice: popcorn on the sidelines...
> Anti-science way? Do you realize how subjective this is and how impossible it is to prove that today there are no other influences at play than biology?

First of all, the original memo said nothing of the sort.

Secondly, I'm pretty sure GP is not saying the reaction to this memo is anti-science merely because it opposes the position taken in the memo. Rather, it's anti-science because they threw all rational debate out the window and fired the guy without even trying to address the points he made.
"To be a woman in tech is also to always and forever be faced with skepticism that I do and feel all those things authentically enough to truly belong."

Isn't it even re-enforced by affirmative actions though? That's kind of exactly what is mentioned in this memo. Such programs hurt women/minorities since there is this suspicion that they're only in the room for a quota.

Point 4 is interesting.
Sure.
http://www.smithsonianmag.com/smart-news/china-launches-larg...

Bio-fouling and corrosion are still huge problems though.
https://worldbuilding.stackexchange.com/ is also a great community, with great discussions. Part science, part fantasy. People tedn to post long fun answers that remind me of XKCD's What If? series.
Steve jobs would have fired an Apple employee for staring at him for too long in the elevator and the press would have written fawning articles about how decisive Steve is, how secretive Apple is, and how much Apple employees fear Steve.

Take any other industry: A friend of mine working for a management consulting firm was fired for losing a presentation and making a partner look bad because the company supplied laptop had a hard disk crash. People have been fired for less.

But Sundar Pichai should take personal responsibility for firing an employee who wrote a jackass memo and caused Google PR harm. If the fellow was not fired, we'd have more articles calling for Sundar Pichai's resignation for making Google a hostile place for women and adding to gender imbalance in the industry. There's no winning strategy here.

Now, if someone is calling for Google CEO's resignation for killing reader, I wholeheartedly agree :-)

Edit: A CEO's job and responsibilities are to his/her shareholders, users and employees. Not to make decisions consistent with their personality traits.
Let me fix that for you:

Google had to decide which they value more: Damore's memo, or their legal defense against inevitable discrimination suits.

---

nb. Large companies are a constant target for litigants of all stripes. There are suits of all types filed against them regularly. They must be careful or, under current law, a bitter employee who was not in actuality discriminated against can successfully claim discrimination and pilfer millions of dollars from the company, inviting follow-on after follow-on. Because the current law is based upon reading in/assuming specific motives to otherwise-valid actions, companies are forced to assume a defensive legal position, such that the other side's lawyer will have a large amount of difficulty convincing a judge and/or jury that such motives were allowed or tolerated.
How to be a 40 year old maker
I'm almost 40 years old, and I've been a developer for over 10 years.
I have been using the computer since I was 14 years old.
I've seen a lot happen in the technology industry.
I wish I had created some significant product.
But I start things, and I'm not done.
I think it's not just lack of focus.
I easily lose my confidence with my ideas.
How do you guys become a maker?
Keep focus, and believe in your own ideas?
Another problem is that with age, I am getting more and more comfortable.
At age 40, have you spent the time to create a technology startup?
Is it possible to change at age 40, or is my time over?
Thanks!

I built Requester so that its syntax would be identical to Requests' syntax, so I wouldn't have to come up with my own syntax for the plugin. Requests' syntax is _extensively_ documented, and improving on it would be quite a tall order.

Are there any features you think would be nice that aren't here?
Not sure if by "converting" you mean retrofitting old buses or replacing diesel buses with new electric buses. If it's the former definition, it's non-trivial from a safety and engineering standpoint to integrate a high-voltage, high-energy battery system into an old bus and expect to realize a decent ROI. Those old clunkers are not designed with an electric powertrain nor efficiency (i.e. they're heavy and have have drag coefficients) in mind. Furthermore, safety is paramount in most bus operations, and a lot of thought needs to go into mitigating thermal runaway or other catastrophic failure modes with systems of that voltage (100s of V) and energy (300kWh+). Depending on the existing bus system that the battery needs to be integrated into, this can be challenging and sometimes infeasible.

I say all of this more to make the argument that rather than retrofit old buses, in my opinion it makes more sense to outright replace them. Right now Proterra is the largest domestic producer of pure electric buses. They compete on most contracts with BYD in China, and New Flyer in Canada. Behind BYD and the government, the electric bus market in China has absolutely exploded over the last several years. Proterra is anticipating high growth in the U.S. market as well and just launched a new factory in LA last month [2].

[1]https://www.proterra.com
[2]https://www.forbes.com/sites/alanohnsman/2017/07/26/proterra...
It's not really a bubble from the financial risk perspective if there isn't a way to "correct" or collapse it.

Machine Learning is a feature set inside an application inside a market. It's not an industry of it's own where massive swaths of an industry place their money or livelihoods, like e-commerce or derivatives.

So in that sense there isn't any bubble to burst. The majority of ML applications are happening INSIDE massive technology companies, not as stand alone companies. Even then, the stand alone companies have a product that they are selling that ML functions with. So SaaS with ML, or Image Captioning or Translation service etc...
Mint's pretty great. I use it because it's basically a lightweight Ubuntu.
Microsoft Unveils Coco: An Open-Source Blockchain Framework
> The browser targets for BS3 were IE8+ and iOS+. BS4 is IE10+ and iOS 7+. IE10 is 5 years old.

Sorry, that's my bad for forgetting my audience. My day to day job is to keep things running in IE8 in Quirks Mode. (With a really bad WYSIWYG editor to boot, inside of one of over 30 frames loaded on the page)

So in my eyes, IE10 is pretty modern. Not so to the average HN reader. My bad.

Still, IE10 is definitely close enough to standards that most of jQuery is wasted on it. Not all, and the parts that are helpful are indeed better tested than writing something yourself.

But I find once you start targeting IE10+, most of the time jQuery is a thing to hang pseudo globals off of, and a way to type `$` instead of `document.querySelectorAll`. And in that role, it's not worth the cycles it burns.

EDIT: In particular, the thing that gets me is when I go to look up a library and it is only available as a jQuery plugin. But looking inside the code the only uses of jQuery are for selectors, events, and http requests, all three of which are standardized and easy to use without jQuery.
> I've been using Linux Mint for years now as my main desktop.

It's amazing considering he signed himself under article reporting Mint containing malware.[1] Fool me once..

[1] http://www.zdnet.com/article/has-your-linux-mint-desktop-bee...

EDIT:

I dug a few more.

http://www.infoworld.com/article/2703044/does-linux-mint-nee...

https://www.reddit.com/r/linux/comments/1osyn5/linux_mint_cr...

Just stay away from this train wreck of mismanagement.
FCC is now a Captured Agency (https://en.wikipedia.org/wiki/Regulatory_capture)
There is at least a sense that the scientist in question disagrees with the application of their research as it stands.

Further, more recent research cited here, Brian Nosek (PhD Psychology):

“My takeaways: Some observed effects are easy to attribute to culture and hard to attribute to biology in the simplistic dichotomy. Active discrimination occurs and is dramatic, but effects of culture seem more commonly subtle shaping of preferences and desires. And, its a really hard problem. Still room for bio, culture, and bioXculture interactions in ultimate accounts.”

https://twitter.com/BrianNosek/status/895410735412543492

And finally, perhaps one of the more well qualified individuals, Suzanne Sadedin (PhD Evolutionary Biology, BA Psychology, and BSc Zoology):

“Yes, men and women are biologically different — which doesn’t mean what the author thinks it does. The article perniciously misrepresents the nature and significance of known sex differences to advance what appears to be a covert alt-right agenda.”

https://www.quora.com/What-do-scientists-think-about-the-bio...

TL;DR: The “facts” that many insist on, aren't quite as genuinely legible as the screed attempts to make them out to be. Ms. Sadedin’s commentary on the internal memo seems most critical of the interpretation.
> He's not helping it by making himself a darling of the right wing media. That and lowball jabs at political correctness and Marxism make it a little too obvious where his sympathies lie and if he really wanted an objective debate picking sides doesn't help.

Exactly. Retweeting people like Cernovich makes it very clear what his agenda really is
> That domain is part of the DMCA copyright access control platform Admiral provides publishers so they can engage visitors in a transparent way on the value exchange for their copyrighted content, instead of resorting to surprise ad reinsertion the way some of our competitors advocate but visitors and advertisers dislike.

Does anyone actually understand what this garbage paragraph is actually saying? It stinks of corporate-esque bullshit to me.
The DMCA doesn't just let you request the takedown of copyrighted content. It lets you request the takedown of tools which can be used to "circumvent technological restrictions" on accessing other, unrelated copyrighted content.

So for instance, when the CSS encryption on DVDs was broken, there were DMCA takedown requests issued to sites hosting the deCSS decryption code, even though the copyright of that code itself wasn't at issue.

ETA: a comment below corrects me, saying that the DMCA prohibits distribution of circumvention tools (i.e. makes it illegal and even criminal I think), but doesn't allow takedown notices for such tools: you have to actually sue them in court. So this takedown notice seems to have been incorrect even if the DMCA is invoked.
How do I make my teamlead grow?
I am managing a development team with both onshore and offshore developers, approx 15 people. This is a regular IT organization for a large, global retailer.

The team lead I recruited (contractor) did not have previous leadership experience, he was a developer prior but never for this company. I have tried to coach him, while pointing out all the "pitfalls" in our complex application landscape. The problem is that I don't feel we get good rapport. When I point out important considerations, he becomes defensive, like I criticized him. Meanwhile, I also feel he does not take in the complexities of problems, but picks up the first "firm" opinion he hears and takes it for granted. This has lead to unneccessary problems because he did not consult his developers. I wish he takes more input from different people, including members of his team.

I know I probably should let him make mistakes and learn from it, but I can't afford costly mistakes (such as unplanned service downtime). Now I feel I am micromanaging him to some extent. I wish to get away from that but may have a problem myself to "release control".

Any suggestions?
Why financial inclusiveness is partly a technical problem
This is what happens when a startup fails. The problem with SoundCloud is that Spotify ate their lunch. I'm not sure this is solvable -- it's like being second place to eBay. Trainor might not be able to do much unless he pivots the company Jobs-style, which isn't an easy feat.

I have to wonder why the VC sunk more money into SoundCloud. Do they see an opportunity we don't? Or is it politicking? Hard to tell.
This is probably going to be buried but YES, my weekly newsletter The Random Roundup(https://tinyletter.com/randomroundup)
Granted, down the line I may be able to leverage the audience for something but right now sharing the gems I find while hitch hiking the internet is so awesome I'd probably even pay to do it.
The headlined article explains that it is Debian 9, which does not have eudev, nor vdev (which is in Devuan), nor Suckless mdev.
and the word "Brutalism" originally referred to the material, béton brut (poured concrete), not a philosophy of being brutal.
Yep. I do it in a slightly different way. I have uMatrix installed as a browser add-on to help control for privacy, fingerprinting, security etc. But it can also be used for stuff like this. Simply disabling scripts on many sites' root domain and hitting refresh solves paywalls and adblock prevention on a fair amount of sites. For others it obviously doesn't work and nothing will load, but it works on more than you may expect.