
Today we were fighting a network issue which caused some bots (actually, about 10% of our hosted bots) to login and logout periodically.
The problem started with some bots getting frozen: they were not responding to the watchdog service commands (this is a SmartBots internal service which pokes bots periodically to restart those which lost a connection to the reality). Thus, bots began to restart.
However, the bots just restarted were still unavailable: they were connecting but then frozen again. Our emergency team got a signal that something is wrong: the number of crazy bots has increased to several percents. Even during a SL rolling restarts, this amount never exceeds 2-3% of bots total.
As you may know, SmartBots was using AI chatbots made by Pandorabots.
We’ve encountered login errors at
“Sim-border crossing” is the moment when you (your your bot) moves from one region to another (a nearby one). A lot of SL projects (for example, traveling) cover multiple sims.
