Ben on BBO - Feedback thread Discussions about Ben models trained on BBO data
#81
Posted 2024-January-19, 12:10
I did some improvements which I plan to push to Ben & Friends sometime next week.
Fixed the bug when it was running from double hoping to escape double.
Toned down the crazy bidding by making it fear getting doubled more. This reduces boldness and insanity a bit.
Grafted gib onto ben. Gib has priorities on its bidding rules. When a very high priority rule applies (e.g when answering blackwood) then we just obey gib's suggestion. This should remove annoyance of wrong blackwood answer, passing forcing bids and similar.
Next I plan to improve the card play, maybe some signalling etc. Let's see
#82
Posted 2024-January-19, 14:04
lorserker, on 2024-January-19, 12:10, said:
That sounds much more promising an approach. As well as the priority system, GIB has flags for when it's allowed to deviate from the book bid, so that's another potential way of detecting forcing situations. (Some of GIBs highest priority rules are leaping to slam, when slower routes would have been more advisable; simulations don't help it understand the information gathering advantages, but maybe it would help Ben. Or maybe this hybrid version should be called Gen.)
The good thing is that you can empirically test the difference; generate a large set of hands, let GIB handle the cardplay at both tables, but Ben the bidding at one. If you can average a positive result, you're definitely making forward progress.
#83
Posted 2024-January-20, 07:49
With AKxx AJx Qxx 98x Ben opens 1C. With x Kxx xx AKQJTxx Responder bids 2C. Then 2NT from Ben and 3H from Responder (4NT is identified as quantitative). Ben bids 3NT and 4NT is now identified as Ace asking in Clubs (bid despite a useless xx in D). Ben bids 5C (0 or 3, etc).
Why? Is Ben afraid to go past 5C? Some other esoteric reasoning?
#84
Posted 2024-January-20, 08:17
Joe_Old, on 2024-January-20, 07:49, said:
With AKxx AJx Qxx 98x Ben opens 1C. With x Kxx xx AKQJTxx Responder bids 2C. Then 2NT from Ben and 3H from Responder (4NT is identified as quantitative). Ben bids 3NT and 4NT is now identified as Ace asking in Clubs (bid despite a useless xx in D). Ben bids 5C (0 or 3, etc).
Why? Is Ben afraid to go past 5C? Some other esoteric reasoning?
Just clumsy bidding, no deeper reason. We'll try to improve this.
#85
Posted 2024-January-20, 08:24
lorserker, on 2024-January-20, 08:17, said:
Is it? From the bidding Ben could easily imply lack of a D honor in Responder's hand. But, an intelligent Responder would have Diamond shortness, and still want to be in a Club slam opposite Ben's actual hand. Do we really know the extent of Ben's understanding on that issue?
#86
Posted 2024-January-20, 11:02
Joe_Old, on 2024-January-20, 08:24, said:
If you post the link to the hand, I could run it through Ben to see what exactly it had in "mind" and what bids it considered.
#87
Posted 2024-January-20, 11:51
lorserker, on 2024-January-20, 11:02, said:
Sorry, I haven't the faintest idea how. The hand was from today's daylong (1/20/24), assuming that you have access to BBO's files.
#88
Posted 2024-January-21, 03:50
Club on trick 6 seems like an obviously bad play, his partner has preempted diamonds and I have the rest of the club tricks showing in dummy
#89
Posted 2024-January-21, 07:28
On 4NT Ben bid 5C which according to the explanation showed 0 or 3 key cards
I would expect that a robot trained on millions of hands is capable of counting its key cards
What's the point of such an undertaking if Ben can not count?
Please explain
#90
Posted 2024-January-21, 10:00
rhm, on 2024-January-21, 07:28, said:
On 4NT Ben bid 5C which according to the explanation showed 0 or 3 key cards
I would expect that a robot trained on millions of hands is capable of counting its key cards
What's the point of such an undertaking if Ben can not count?
Please explain
sorry about this. i don't have anything smart to say except "hang on, we are fixing it in the next version"
thanks for having given it a try.
#91
Posted 2024-January-21, 11:14
#92
Posted 2024-January-21, 12:11
However it plays Meckwell lite so it might not be what you expect.
#93
Posted 2024-January-22, 06:08
guinnypoo, on 2024-January-21, 03:50, said:
Club on trick 6 seems like an obviously bad play, his partner has preempted diamonds and I have the rest of the club tricks showing in dummy
This is an interesting aspect of robot play.
As humans we "know" that partner don't have a trump, as that would be very bad declarer play, but as a robot it simulates the deal, and finds that partner might have a trump, so that is the only chance for setting declarer.
Mobile : +45 22 99 55 25
http://www.netbridge.dk
http://www.thorvald.dk
#94
Posted 2024-January-22, 07:27
There's a bunch of really good third party bridge programs - think WinBridge or Jack or ....
You'll get the most bang for the buck by licensing these (or allowing folks to rent these) rather than yet another stand alone project
#95
Posted 2024-January-22, 07:31
hrothgar, on 2024-January-22, 07:27, said:
Intobridge does this.
As for Jack, they have their own playing site already so they would need strong incentives to integrate it in other sites.
#96
Posted 2024-January-23, 07:29
- made bidding more reliable
- tamed crazy bidding in competition
- opening leads are a bit more normal (human)
Many thanks for playing and reporting issues.
#97
Posted 2024-January-23, 10:59
hrothgar, on 2024-January-22, 07:27, said:
helene_t, on 2024-January-22, 07:31, said:
I agree and would like to see BBO and it's competitors working together to define generic standard robot interfaces that require little or preferably no integration specific to each platform. And with the involvement of WBF, although I can imagine what hrothgar has to say about that
#99
Posted 2024-January-26, 03:32
#100
Posted 2024-January-26, 07:44
Have you tried just normal blackwood does the lack of a 5th ace make it learn correctly ?
We might have to end up just hard coding the RKCB responses, but it does seem weird that it can't learn it.
And indeed wrong answers still common to RKCB, really odd so more data may not be the answer, moving on to leaping michaels, and then the impossible to get right doubles.