The Slow Climb of Postgres and the Value of Persistence

Those intrepid individuals trying to bring a new innovation into the world, or a new start-up, should keep in mind the power of perseverance. Even if a technology is a hit, the creator must still face any number of hurdles to maintain and grow its success.

Attendees at the PostgresVision conference in Boston this week certainly heard a great testimonial for this idea, as database pioneer Dr. Michael Stonebraker offered an account of how he helped bring PostgreSQL database into the world, a 15 year journey of amazing highs and lows.

Stonebraker had already helped birth the first world’s first relational database, Ingres, a decade before, but he was back in the laboratory in early 1980s to create Postgres (later amended to “PostgreSQL” to reflect its SQL powers). Ingres was such a success. In fact, that users wanted to add their more arbitrary data types and operators to its schema, for use cases such as geolocation, he explained. The initial workaround to this problem with Ingres to encapsulate that logic within application code, often with the horribly unintuitive Prolog.

So the idea with Postgres, which debuted in 1984, would be to offer a relational database system with support for “advanced data types” (ADTs). ADTs set the stage for much wider use of relational databases, the new capability — built on object-relational mapping — saving untold hours in developer effort. Postgres was also the first database system not to overwrite data when an update was needed, and instead, just add a new entry and delete the old one, which opened the door to capturing a verifiable transactional history.

But Postgres was anything but an immediate success, no matter how obvious its value. First Stonebraker and his team had the seemingly good idea to write this new database in the best possible language of the day, LISP. LISP, however, turned out to be a terrible choice, because of its slow performance — not a characteristic you’d want in a database. So a rewrite into the much more performant C was necessary.

They also ran into a potentially-crippling catch 22. Early users wanted not just the crude ADTs created by the Postgres developers. They wanted sophisticated ADTs to work with the commercial applications they used, such as geo-mapping software from Arcvinfo. But when they approached companies such as ArcInfo and asked for their help, they were told the Postgres user base wasn’t then large enough to warrant such an effort. The lack of commercial ADTs would keep Postgres on the sideline, yet software vendors weren’t interested in creating ADTs for their own products no matter how useful they would be to Postgres end-users.

The database designers were seemingly stuck, at least until another use-case came into view, supporting the then-nascent but rapidly-growing Internet, and gave Postgres a bountiful user-base. In 1996, Stonebraker sold the company he formed, Illustra, to commercialize the database system, and went on to create other databases for other use-cases, such as analytics oriented Vertica.

These days, Postgres is the currently fourth most widely-used database system, according to the DB-Engines Ranking, just ahead of NoSQL MongoDB. EnterpriseDB, which offers commercial support for the open source database (and is the organizing sponsor for Postgres Vision),  sponsored an independently-executed benchmark test to compare Postgres and MongoDB, which was just enhanced with multi-transactional capabilities.

Despite MongoDB’s fast performance, the benchmarking company, Ongres, found that MongoDB had difficulty matching the transactional performance of Postgres. And, with more than 16 threads, Postgres left MongoDB in the dust entirely.

“PostgreSQL 11 was found to be faster than MongoDB 4.0 in almost every benchmark,” the report concluded. “Throughput was higher, ranging from dozens of percentage points up to one and even two orders of magnitude on some benchmarks. Latency, when measured by the benchmark, was also lower on PostgreSQL.”

Work still needs to be done to give Postgres multi-master capability, which would make it truly scalable, across multiple servers. Still, its presence in today’s business stack is not too shabby for software that is 35 years old.

Good ideas never come from “communing with nature on a mountaintop,” Stonebraker said. They come from talking with users, many users. Serendipity always helps (and anti-serendipity always hurts), but that is beyond your control.

And most importantly, Stonebraker reminds us that success comes from persistence, weathering the inevitable lows as well as the highs.

The religious right carries its golden calf into Steve Bannon’s battles

At the Family Research Council’s recent Values Voter Summit, the religious right effectively declared its conversion to Trumpism.

.. A time to live and a time to die. A time to plant and a time to uproot. A time to mourn and a time to embrace angry ethnonationalism and racial demagoguery. Yes, a time to mourn.

.. Evidently the Christian approach to social justice is miraculously identical to 1930s Republican protectionism, isolationism and nativism.
.. Rather than confidently and persistently representing a set of distinctive beliefs, they pant and beg to be a part of someone else’s movement. In this case, it is a movement that takes advantage of racial and ethnic divisions and dehumanizes Muslims, migrants and refugees.
.. If Christian conservatives are loyal enough, Bannon promises that they can be “the folks who saved the Judeo-Christian West.”
.. All that is required is to abandon the best of the Judeo-Christian tradition: a belief in the inherent value and dignity of every life.
.. It means that the primary mission of Christians in public life is not to secure their own interests or to defend their own identity. It is to seek a society in which every person can flourish. This is the definition of the common good — which is not truly common unless it includes the suffering and powerless.
.. If there is a single reason that Republican health-care reform has failed, it is because party leaders could not make a credible case that the common good was being served.
.. Who would now identify conservative Christian political engagement with the pursuit of the common good? Rather, the religious right is an interest group seeking preference and advancement from a strongman — and rewarding him with loyal acceptance of his priorities.
.. They are associating the teachings of Jesus Christ — a globalist when it came to the Great Commission — with ethnonationalist ideology. This should be a sobering prospect for any Christian. But few seem sobered. Instead, the faithful give standing ovations to the purveyors of division and prejudice.
.. When anyone or anything takes priority over the faith, there is a good, strong religious word for it: idolatry. And the word is unavoidable, as religious conservatives carry their golden calf into Bannon’s battles.

Violence. Threats. Begging. Harvey Weinstein’s 30-year pattern of abuse in Hollywood.

“Everyone knew these stories,” one Hollywood publicist said. “Not the specifics. But people knew it was a hostile work environment, and that he was a bully to people. Because he could win you an Oscar, we were all supposed to look the other way.”

.. when the New Yorker published a 2015 audio recording of Weinstein trying to lure a model into his hotel room, Brewer was stopped cold.

.. Weinstein, enraged that he had been out of pocket for a few hours, lunged at him and began punching him in the head, Brewer said; the skirmish tumbled into the corridor and then the elevator. By the time Brewer reached the street, intent on never associating with the Weinsteins again, he said, Harvey was pleading for him to stay and help ensure that their film got launched.

.. “Listening to the audiotape, it gave me this visceral reaction to my experience that day,” Brewer said by phone Thursday. “This alternating between violence, threats, commands and then begging, mock-crying, trying anything — any angle to get what he wanted.”

.. a genius of promotion who persuaded Oscar voters to pick his lighthearted “Shakespeare in Love” over epic front-runner “Saving Private Ryan” as best picture in 1999.

.. He had a “funny, whiny” voice, and was often bullied, according to former classmates, but he was persistent, sure of himself, an operator.

.. “He was supremely confident, and not worried about any repercussions,” the friend recalled. “It was like, ‘Eh, if they catch me, so what, I’ll do it again.’ ”

.. Weinstein went into business with his brother, first as concert promoters and later

.. “Don’t mention the competition on the air. Don’t put two car ads in the same segment,” she said this past week. “And, if you’re a young woman, don’t be alone with Harvey Weinstein.”

.. His job then wasn’t to make movies but to discover them and get them into theaters. His forcefulness was a boon for independent and foreign films that lacked bankable names. He would be their star, their champion, deploying a brassy, fearless persona to conduct cutthroat negotiations and impassioned publicity campaigns.

.. “Harvey has a bargaining quality, a back-and-forth bullying that makes you just go ‘okay,’ she explained. She jumped out of their taxi blocks later and ran inside a bar, begging the bartender to pretend that he was her boyfriend.

.. “He’s very seductive at the start,” Leight said. “You think he understands you and your destiny is about to change.”

.. But Weinstein’s behavior was erratic. Leight said Weinstein pressured him to ask an actress to “show tit” on screen, though the script required no nudity.

.. In retrospect, he said, the abusive tactics that Weinstein used with women were in line with those he used with directors and male employees: the domination, the cycle of eruptions followed by contrition, the swagger, accompanied by shows of neediness.

“It’s absolutely the same behavior,” Leight said.

..  the Peninsula Beverly Hills hotel, where the New York-based producer often stayed, and where many of his alleged assaults were said to have taken place.

.. people knew that if you had worked there, you could put up with anything.”

.. West Coast employees employed a system of alerts, passed along by whisper, to prepare for the boss’s arrival.

Harvey is coming.

Harvey is five minutes out.

Harvey is on a kick about “Tulip Fever.” If you haven’t seen it, make sure you do now.

.. One preparation — described by multiple individuals and recognized as both practical and ridiculous — was to hide all the office candy bowls.

“He would take and eat them all and his blood sugar would spike,” the former employee explained. “We were trying to control his moods.”

.. The mood swings, the employee said, were frequent and relentless. Workers discussed in hushed tones how to manage them.

.. “It was not clear that he was assaulting people,” the former employee said. “But was it clear that he was trading his power for sexual favors? Yes.”

.. “What you have to understand is, Harvey was somebody who everybody who worked there didn’t like,” another former employee said. “Talking s— about Harvey was the normal course of action. He’s disgusting. He’s rude. He has food on his shirt.”

.. Weinstein’s blatant bad behavior managed to mask his more insidious tendencies. In other words, you didn’t believe he could be any worse in private than you had seen him behave in public.

.. Some women who have made claims against Weinstein have alleged that his assistants were facilitators of his behavior, or said they were in the room immediately before he assaulted them.

.. “I just thought we were seeing the bad end of a bad temper,” said one industry professional, who often encountered him over several decades. “I once watched him fire his whole staff at an awards show. It was one of the worst things I’ve witnessed — they were running away in tears and crying in parking lots.”

.. “Here’s a man who would take a little film that couldn’t and make it into hits that won Oscars,” said the publicist who watched Weinstein fire his entire staff. “He wasn’t the only one to do that, but he had a really good track record. Sometimes, to do that, you have to be a steamroller. I don’t know if that’s right or wrong. I think it’s wrong.” A pause. “I’m sure it’s wrong.”

.. “He said, ‘What have you heard about me?’” Masters said. “And I said, ‘I’ve heard you rape women.’ ”

Weinstein responded, Masters said, “with neither shock nor anger.”

.. Masters said the magazine tried “really hard” to publish a report on Weinstein’s sexual behavior a few years ago. But the source backed out, leaving it without on-the-record corroboration of festering rumors.

.. Harvey was the Trump of the movie industry. He knew what was a good story. He knew how it worked. He knew what a deadline was. He knew about the caring and feeding of gossip columns.”

..  a frequent source of scoops and celebrity gossip for tabloid papers.

.. Many Weinstein-watchers took note of what seemed to be an orchestrated media campaign against Ambra Battilana Gutierrez, the model who accused Weinstein of groping her in a Tribeca hotel room in 2015.

.. The New York Post published photos of her in a bikini and labeled her “Grope Beauty” on its cover. Its Page Six column reported that a police source said there was no physical evidence for Gutierrez’s claim. In fact, Gutierrez had worn a hidden police microphone and recorded Weinstein apologizing to her for the incident.

.. Weinstein had a knack for flattering reporters. He once had his staff put together a mock poster for “Page Six: The Movie” — starring George Clooney, Nicole Kidman, Russell Crowe, Mel Gibson and Matt Damon as the column’s authors — and sent it to the newsroom.

.. Weinstein “cajoled and threatened” him when he wouldn’t kill an item about Weinstein’s divorce from Eve. Weinstein first tried to trade the item for another bit of gossip, Grove said, and next threatened to ban him from Miramax’s film screenings. Grove said he could buy his own movie tickets.

.. Eventually, Grove said, Weinstein backed down when he realized he had no leverage. But first, he said something Grove said “should be embroidered on a pillow. He said, ‘I’m the scariest m—–f—– you’ll ever have as an enemy in this town.’ ”

.. He implied that she needed him. He’d set up a Hollywood world in which everyone needed him.

.. I had dinner with this guy and it turns out he is everything I stand against.”

.. fundraisers alongside Leonardo DiCaprio, the premiere of “Shakespeare in Love” with Hillary Clinton on his arm.

.. His personal giving was dwarfed by that of many other showbiz moguls — only $1.8 million since 1979. But when President Bill Clinton sought help for his legal-defense fund during the Monica Lewinsky saga, Weinstein cut a $10,000 check.

.. Brown, who said she had never heard anything but milder rumors about Weinstein, called the election “a tipping point for a great many women.”

.. lawyer Gloria Allred. She is representing several of Weinstein’s accusers, but said she has “also been getting calls about other men in Hollywood. Studio executives, A-list actors. Big names. Names you would know.”

.. Though she represented more than 30 of Cosby’s victims, she said she suspects “this is going to be bigger. It’s a tsunami.”

.. he championed his boys — and there were no female voices in there.

.. The lack of female voices in Hollywood, Delavigne said, is “a more entrenched danger, and entrenched culture.” A common note she receives from producers, during the screenwriting process, is to make her female characters more “likable.” That one word, she said, epitomizes the film industry’s attitude about women.

.. “It is not ‘likable’ for a woman to say ‘no,’ to say ‘you can’t do that,’ ” Delavigne said. “That is not likable. That is not charming. That is not sweet.”

.. “He had just a very forceful way of going about things,”

.. “He forces himself on you, talks you into it and doesn’t leave you with an option.”

.. He was both needy and abusive

Trash Talk Improves Persistence of its Targets, Hurts Creativity

A little trash talking might just work—for the target. Psychologists define “trash talk” as boasts or insults delivered before or during a competition. It is prevalent in sports, business, politics and the military—and common between friends or family members when they find themselves competing.

targets of trash talk performed better on tasks requiring persistence, though worse on those requiring creativity.