Poker Games Online With Bots

Duane Hoffmann / MSNBC

Warbot is Openholdem-based, customizable universal poker bot, which uses screen scraping method for its game state engine, and external profiles (formulas, algorithms) for its action engine (Autoplayer). The bot automatically detects poker table, when it appears on the screen. Then it connects and starts playing, according to loaded profile. Feb 13, 2017  What’s it like to play poker against an AI bot? Really weird and really difficult, it turns out. AI Poker Bots Are Beating The World's Best Players (HBO). The bot’s win has numerous.

updated 9/21/2004 11:35:31 PM ET2004-09-22T03:35:31
  • Print
  • Font:
  • +
  • -

Pull up a chair at a friendly poker game in a buddy’s den and you probably know the other players and have some idea of their card-playing weaknesses – like Big Al's habit of fingering his chips when he's itching to raise. But take a seat at a table in one of the rapidly multiplying online card rooms and there's no telling who’s sitting to your right – or if the player is even human.

Concern is growing in online chat rooms and news groups devoted to poker that sophisticated card-playing robots – known as “bots” in the nomenclature of the Web – are being used on commercial gambling sites to fleece newcomers, the strategy-impaired and maybe even above-average players.

“It is pretty much a certainty that bots are playing online,” said Gautam Rao, a 43-year-old Canadian poker pro who regularly plays three high-stakes Internet games simultaneously. “… What we don’t know is how strong they are.”

Online Poker Bot Software Free

Widespread use of bots capable of beating your average player would pose a significant problem for the red-hot online poker sector, which has grown exponentially in recent years and is expected to top the $1 billion revenue mark this year. Without some way of verifying the identity – and humanity – of players, the business could be significantly undercut.

Many don't see a threat
But skeptics – and there are many – argue the complexities of the game and the changing strategies ensure that creation of a program that can “read” opponents’ cards using screen scanning techniques and respond in real time is years away at best. They point to the handful of commercial products that purport to give online players significant advantage, which they roundly deride as woefully inadequate, as proof today's bots are no match for humans.

Rao and his fellow believers have a ready answer: A bot capable of playing against the best humans already exists.

The University of Alberta’s Computer Poker Research Group has developed an artificially intelligent automaton known as “Vex Bot,” capable of playing poker at the master level, though as yet it can only apply its gambling genius to two-player games. Vex Bot has been used by researchers to test the frontiers of artificial intelligence – and as the basis for a commercial poker tutorial program, Poki’s Poker Academy -- but some fear it may become a blueprint for programmers with more sinister motives.

Darse Billings, lead designer of the Vex Bot said he believes the odds are better than 50-50 that other programmers have secretly unleashed bots on commercial poker sites, apart from the commercial bots. But he throws his chips in with the skeptics, saying it is unlikely they would be anywhere near as capable as the Vex Bot – so named for its ability to frustrate human opponents – which is the result of more than a decade’s research by the University of Alberta team.

Poker bot download

“The strategy of the game is difficult and to sit down and write a program that can beat a table of experienced human players is no trivial task,” he said.

While bots have been used to play the optimal strategy in other online card games, like blackjack, poker is a different animal. The biggest obstacles lie in the amount of information unavailable to the player and the need for the program to be able to employ a variety of strategies at different times, such as bluffing and laying traps for opponents, explained Billings, a doctoral student and master poker player.

‘A program that can think’
“With chess – I don’t want to trivialize it – but it’s just a matter of calculation,” he said. “With poker, you really need to write a program that can think about the game and reason.”

Poker bot forum

The solution, in the case of the Vex Bot, was adding a layer of artificial intelligence over its ability to calculate probabilities.

“It will show you things that no human player has ever shown you before,” Billings said of the latest incarnation of the bot, which also has the ability to model its opponent’s behavior. “… One of the biggest advantages that programs have is that they have no fear, no shame. Humans can be intimidated. They will back off in the face of a very aggressive player. A bot will not. It has no compunction about doing whatever it will take to win. It will raise you with any two cards if it thinks that it has a very slight advantage based on your history. And it can induce a lot of anger and emotional upset. These things are ‘tilt monsters.’”

Rao, who served as one of the testers of Vex Bot, attests to its skills.

“It was a formidable foe,” he said of his initial encounter with the bot, before the addition of its new feature. “I can see that (the improved) bot, given enough hands, will become an absolute world beater.”

While the Vex Bot is undeniably at the head of its class, the mere existence of bots is a sensitive subject for operators of poker sites, all of which appear to have policies prohibiting their use.

“I can’t imagine that any good can come of this interview,” Bob Wolf of TiltWare LLC, a Los Angeles-based software developer that licenses its poker game to a company that operates the Fulltiltpoker.com site, wrote in rejecting to an interview request.

Operators of other poker sites and creators of poker software interviewed by MSNBC.com said they have been able to defeat bots by monitoring the sites for suspicious patterns of play and tweaking software to foil the commercial bots.

A game of cat and bot
“There are a few commercially available programs which people have tried to use,” said Vikrant Bhargava, general manager of Partypoker.com, the biggest poker site on the Internet. “We make a change and these guys again try to beat the system. With our last update, I believe we have rendered the commercially available bots useless.”

Bhargava, whose site hosts more than 50,000 players at upwards of 5,000 tables during peak hours, also said playing against the existing class of bots is an opportunity rather than a hazard.

'If I were a player I think I would like to play against a bot. … I would take the bot’s money.”

Nancy Chan-Palmateer, a spokeswoman for Canadian software maker CryptoLogic, which oversees the online card room used by its eight poker licensees on the Caribbean island of Curacao, said some players have been banned from the member sites for suspicious patterns of play that could indicate use of bots.

“Sometimes you don’t know if it’s specifically (bots) … but certainly we’ve blocked players that have shown unusual activity,” she said.

But Ray Bornert II, whose company makes WinHoldEm, billed as “a programmable pokerbot,” said his company developed a two-computer strategy to foil attempts to block its users.

Selective enforcement charged
Bornert criticized poker sites for singling out his firm’s products – which includes a “Team Edition” that allows players to see one another’s cards, in violation of rules against collusion -- while failing to ensure that others also are playing by the rules.

“We take issue with the poker sites because they do not do enough to communicate the fact that it is impossible to physically secure their no-bots, no-teams policies in an online environment,” he wrote in reply to an e-mail question. “... If the poker sites cannot physically secure their no-bots, no-teams policies then they need to cease their persecution of players who are resorting to such measures in order to adequately defend themselves against opponents that have already seen the light. Players should be free to fight fire with fire without being bullied by the poker rooms.”

Video: Poker 'bots' He also quarreled with those who say the software is ineffective, maintaining that it increased its original bankroll by 35 percent in a five-day test in January in which it was used to play 7,000 hands. He acknowledged, though, that its ability to beat human players depends on the user’s skill in setting the formula that it uses to play.

Rao, the professional player, also expressed doubts about the poker sites’ professed zero tolerance of bots, though for a different reason. He said site operators make for bad cops when it comes to policing bots since they still collect the house “rake” – the percentage taken from each pot – whether the player is human or software.

“They’ll turn a blind eye as long as it’s trivial … as long as that bot pays its rake for every pot and as long as it doesn’t undermine the confidence (of the other players),” he said.

Proliferation of sites presents opportunity
Moreover, Rao said, the proliferation of poker sites presents an excellent opportunity for anyone with a bot that can eke out a slim profit to fly under the radar of those looking for unusual playing patterns.

“If you’ve got a bot that can play 25 casinos, two tables apiece, even if you’re playing a (mid-level) $10/$20 game … that’s $1,000 an hour,” he said.

And if such a bot is created, how long will its author be able to keep it secret?

“It’s only a matter of time before a talented poker player who also happens to be a good developer decides she or he wants to be remembered as the author of the first bot that changed online poker forever,” an author who goes by the screen name “loic” lamented recently in the Twoplustwo.com poker forum.

Poker Bot Forum

But Billings, creator of Vex Bot, expects online poker to continue to thrive in spite of efforts to develop the “killer bot.” In fact, he added, it may grow even faster.

“I don’t foresee a danger of bots killing the game in any sense,” he said. “More likely, there will be a large contribution of cash from people who try to create bots and fail.”

© 2013 msnbc.com Reprints

Bryan Taylor, 36, could not shake the feeling that something funny was going on. Three of his most frequent opponents on an online poker site were acting oddly, playing in ways that were so similar it was suspicious.

Mr. Taylor, who started playing poker professionally in 2008, suspected that he was competing against computers — specifically bots, short for robots — that had been programmed to play poker and beat the odds.

And he was right. After an investigation, the site Mr. Taylor frequented, PokerStars, determined that his opponents had been computers masquerading as people and shut them down.

Poker bots are not new, but until recently they were not very good. Humans were better at the nuances of the game — at bluffing, for instance — and could routinely beat the machines. But artificial intelligence has come a long way in the last few years, far enough that poker bots are now good enough to win tens of thousands of dollars on major game sites, which are clamping down on them.

The bots that Mr. Taylor identified on PokerStars were shut down in July. In October, another large poker site, Full Tilt, informed customers that it had taken action to limit the proliferation of bots, including freezing some accounts. (Internet gambling is illegal in the United States, but online casinos operate offshore.)

Continue reading the main story

“PokerStars is continuing to invest substantial resources to combat bots,” Michael Josem, a security manager at the site, said in an interview conducted via e-mail. “When a player is identified as a bot, PokerStars removes them from our games as soon as possible.” Their winnings are confiscated, he said, and the company will “provide compensation to players when appropriate.”

Yet poker bots are openly for sale online. Shanky Technologies sells licenses for the Holdem Poker Bot — the target of Full Tilt’s crackdown in October — for $129 per year. Brian Jetter, a co-founder of Shanky, said in an e-mail interview that more than 400 of his customers had been banned from Full Tilt. (Full Tilt did not respond to requests for comment.)

Mr. Jetter said that Full Tilt had seized more than $50,000 of his customers’ money, a figure that he called a “conservative estimate.” He added that the gaming site was forgoing at least $70,000 per month in revenue by shutting down his customers’ bots.

“They really must have wanted us gone,” Mr. Jetter said. “We don’t think the other poker rooms we support will make a similar financial decision.”

According to the Web site PokerScout.com, which bills itself as an Internet poker clearinghouse, there are more than 600 Web sites where people can play online. Mr. Jetter says that while Shanky does not have any “official relationships with the poker rooms,” some of them look the other way when bots play.

The science of poker bots is still in its infancy, which may be one reason that some gambling sites do not crack down on them. Unlike Watson, the I.B.M. computer that won on “Jeopardy!,” poker bots are not stellar players. But they are getting better, thanks to advances in the way computer scientists program software to play games.

“The large majority of bots are very bad,” said Darse Billings, a consultant to PokerStars and Full Tilt and the former chief of data analytics at Full Tilt. “More than 90 percent are losing money.”

Newsletter Sign Up

Continue reading the main story

Thank you for subscribing.

An error has occurred. Please try again later.

You are already subscribed to this email.

  • Opt out or contact us anytime

It turns out to be a lot easier to build a perfect chess player than a poker whiz. Chess is a perfect information game: if you look at a chessboard, you know the exact state of the game from both players’ perspectives. And the rules of the game are not affected by chance, like the drawing of a card.

But in poker, an imperfect information game, there are many unknown variables. A player does not know his opponents’ cards and may not know their style of play — how aggressive they tend to be, for instance, or how often they bluff.

Unlike a chess bot, a poker bot does most of its work before the match, running millions of simulations before the first card is dealt. But even with the large amounts of memory available with today’s computers, storing — or even computing — information for every possible scenario would be implausible.

The best poker bots in the world include those from the University of Alberta Computer Poker Research Group, which is nearly 20 years old. Professor Michael Bowling, who has led the group since 2005, says the breakthrough came in 2003, when researchers decided to change their approach, shifting away from the methodology used to build chess bots.

In 2006, the inaugural Annual Computer Poker Competition created more interest in poker-playing computers and established a friendly rivalry between the University of Alberta and Professor Tuomas W. Sandholm’s poker research group at Carnegie Mellon University in Pittsburgh.

Today, Professor Sandholm said, poker bots “can rival good players, but not the best — yet.”

Many of the poker bots available on the Internet were built by programmers as a personal exercise or hobby. Some buyers think they can make money with the bots, but others use them in intellectual exercises, Mr. Jetter said. Buyers can program their bots to use different decision-making strategies in various circumstances, and then observe which outcomes are more successful when applied in real-world games.

“Using a poker bot is in fact a natural extension of the game of online poker,” said Mr. Jetter, who added that Shanky has sold 5,000 copies of its Holdem Bot software since it was introduced in early 2008. “Creating your own playing profile is a fun challenge that many players enjoy.”

That argument does not go over well at sites like PokerStars. Last year, after it was tipped off by Mr. Taylor, the company found 10 bots and returned more than $57,000 to players who had lost money to them.

The poker bots’ arrival may be just another sign of an emerging world where humans, knowingly or unknowingly, encounter robots on an everyday basis. People already talk with computers when they call customer service centers or drive their cars.

Online Poker Bots For Sale

As for Mr. Taylor, his cleverness in spotting bots won him a job. He now works full time for PokerStars, where “he is helping to protect the integrity of our games,” Mr. Josem said.

Poker Bot Download

And so the human wins — this time.