U.S. Pat. No. 8,376,856

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The present invention provides a method and system for monitoring behavior in a virtual world environment.FIG. 1shows, as an example, a virtual world environment comprised of users102, referred to as Avatars, objects104and groups106. Each user may belong to one or more groups and may have one or more friends110.

The preferred embodiment of the invention is comprised of a number of procedures including: notification of malicious action, selection of jurors, a calculation of rating value; voting; assignment of rating value; propagation of rating values; propagation of ratings by contact between Avatars or between objects; and surveillance by collective intelligence. Each of these procedures is discussed below in detail.

Notification of Malicious Action

When a malicious action such as a terrorist act is done, a user who witnessed the action invokes a collective intelligence avatar (service).

Selection of Jurors

The collective intelligence avatar appears to the place where the action happened, and then starts monitoring the place from this time (descriptions of the monitoring utilizing collective intelligence are discussed below). Concurrently, the collective intelligence avatar randomly selects N users (jurors) from among users who are logging in the virtual world community. The collective intelligence avatar then requests these N users to teleport to the place, and to vote on whether or not the action is malicious. In the selection, the candidates for jurors are not necessarily at that place. For the purpose of selecting N users who have no relations with the malicious action and who are not related with one another, the system (the provider administering the user information) automatically selects jurors Ji (i=1, . . . ,N) in accordance with the following conditions. Group(J) denotes a set of groups to which a jury J belongs. ∀ J, K Group(J) ∩ Group(K)=φ (null), that is, no two jurors belong to the same community. No juror is linked to any other jurors as friends within m (for example, 3) hops. There are no or few similarities in personal information, for example, physical residences, of the users.

By utilizing, as the collective intelligence, users logging in the virtual world, it is possible to judge, with the plural users' eyes, whether the action is malicious or not. In addition, it is also possible to deal with the action in real time. Since the users to be collected are randomly selected by the system from users who satisfy the above-described conditions, it is possible to eliminate biased and unfair judgments. The collective intelligence avatar selects jurors, and then sends an invitation for teleportation to each of these selected jurors. After that, the situation of the action, which has been monitored, is played back for the jurors who have teleported to the place in compliance with the invitation.

A rating value assigned to a user by past actions is used for automating the judgment on whether the action is malicious or not. The rating value used in the preferred embodiment of the present invention is given to each user by leveraging the collective intelligence of users who have no relationship with one another. For this reason, the rating value is resistant to attempts to skew the value by a malicious user groups.

Calculation of Rating Value

Before selecting jurors, the collective intelligence avatar calculates a total rating value A of the user u who is doing the malicious action. The total rating value A is the sum of the rating value of the avatar (user) itself, the rating value of an object possessed by the avatar, and the rating value of a group to which the avatar belongs. The greater the total rating value is, the higher reliability the user has.
A(u)=A1(u)+A2(u)+A3(u)

A1(u): the rating value of the user u him/herself

A2(u): the sum of the rating values of elements in a set of objects possessed by the user u

A3(u): the sum of the rating values of elements in a set of groups to which the user u belongs.

The total rating value A may not be a simple linear sum, but each of these values may be weighted to obtain the total rating value A.

In the same manner, a total rating value A(t) of the informer is calculated. When A(t)−A(u)>M (M is a predetermined constant) is satisfied, the action is automatically judged to be unfair. This judgment is performed for the purpose of solving the case in an early stage, by placing more importance on the judgment of a user having a high rating value which is given to the user in accordance with a past informing act, an act as a juror, and the like. When the above expression is not satisfied, a voting process is carried out.

Voting

Voting is a process in which the user, who has teleported to the place as a juror, judges whether the action done at the place is malicious or not. The voting is done by indicting either Yes or No to a target action by a (maybe malicious) user. When the number of users who judge that the action is malicious by voting on Yes exceeds a predetermined threshold value K, the collective intelligence avatar requests the administrator of the virtual world to cause appropriate action against the user who is doing the malicious action. In addition, when the number of “Yes” votes exceeds the number of “No ” votes even in the middle of the Voting, the collective intelligence avatar requests the administrator to delay the transmission of rendering information, so that the disputed action is interfered with.

Assignment of Rating Value

Whether the action was really malicious or not can be validated by manually examining the action after the occurrence of the incident. As a result of the evaluation, rating values are assigned to the involved users in the following manner.

A positive rating value is assigned to a user who carried out an eventually correct voting. In addition, a reward of the virtual currency or the like is given to the user. A positive rating value is assigned to a user who carried out a correct notification. In addition, a reward of the virtual currency or the like is given to the user. A negative rating value is assigned to the user who did the malicious action. A negative rating value is assigned to each of the objects possessed by the user who did the malicious action, and also to each of the groups to which the user belongs.

Propagation of Rating Values 1

Moreover, the rating values are propagated in the following manner. A negative rating value is assigned to a user possessing an object that is the same as, or similar to, one possessed by the user who did the malicious action. A negative rating value is assigned to each member of the groups to which the user did the malicious action belongs. A negative rating value is assigned to each member of the friend list of the user who did the malicious action.

Propagation of Rating Values 2

As a result of the assignment and the propagation of the rating values, when the absolute value of the rating value of one of the users exceeds a certain threshold value, the user has a significant influence on other users. In this case: a value proportional to the rating value of the user is assigned to each of the friends of the user. The decay of the value to be assigned is set in accordance with a predetermined decay curve. Moreover, when the rating value of a user assigned the value through the propagation exceeds the threshold value, the propagation is carried out again from the user as a starting point.

A user who intends to do a malicious action may frequently change his or her user ID in order to prevent a negative rating value from being assigned to him or her. However, even in such a case, it costs so much for the user to change his or her possessions (objects) for every time he or she changes his or her ID (for example, it is expensive to create a gun for every time). Accordingly, a rating value is assigned to an object, and is then reflected in a total rating value. On the other hand, information on a group is utilized for controlling accesses to places and buildings. Accordingly, by taking rating values to groups into consideration, it is possible to assign rating values to users in a wide range.

Propagation of Rating by Contact between Avatars or Between Objects

When a first avatar chats with a second avatar having a high (or low) rating value, or when a first avatar stays with a second avatar having a high (or low) rating value at the same location for a certain period of time, the rating value of the second avatar is propagated to the first avatar. In addition, when an object possessed by a certain user has a high (or low) rating value, the rating value is also propagated to other objects possessed by the user.

Surveillance by Collective Intelligence

In a virtual world, when plural avatars exist within a certain area, views (displayed by client programs of the users who are operating the corresponding avatars) are different from one another in accordance with the positions of the avatars. When a malicious action is done, the view from each of the avatars who are in the place where the malicious action is being done is recorded as an image or a movie. Then, the recorded image or movie is sent to the server side. In this manner, visual scenes at the site from various angles can be stored. This process is carried out in the following procedures.

The collective intelligence avatar appears at a place where a malicious action is being done, and then starts monitoring the place from this time. Concurrently, the collective intelligence avatar sends monitoring requests to avatars who are in the periphery of the place. The periphery referred to here is calculated on a scale of X meters in radius. On the protocol, this means that the request is sent from the server to the client program of the user who is operating each of the avatars. Upon reception of the request, the client program transmits back, to the server side, a series of snapshots, or a movie, which has been displayed on the screen.

An application example will be given hereinbelow. Specifically, monitoring requests are sent to avatars that are sampled by the server side for places where a malicious action is not done. By receiving the result of the monitoring from each of the corresponding clients, it is possible to carry out a wider-area monitoring (surveillance) without performing heavy processing at the server side.

FIG. 2shows a configuration of the present invention. In this configuration, the server side includes collective intelligence avatar control module204, jury selection module206, voting control module210, rating control module212, monitor database214and user database216.FIG. 2also shows users220, a witness222and jurors224. The present invention can be achieved by adding components shown inFIG. 2to a server environment provided by a virtual world provider (an authentication server or an engine for developing a virtual world and the like are known technologies, and are thus not illustrated). The clients corresponding to the respective users are shown on the right side ofFIG. 2.

The collective intelligence avatar control module receives a notification from a user, then starts up the collective intelligence avatar, and also performs the overall control. The jury selection module accesses a user database, and selects appropriate jurors. The Voting control module communicates with a rating control module, and manages the Voting of the jurors. In the monitor DB, an action that appears to be malicious is stored. The user DB is used for managing possessions, groups, personal information sets, rating values, and the like.

The numbers1-10inFIG. 2indicate the order and the flow of the processing. The procedures of the processing will be described below. The process begins when a malicious actor does some action. At step1, a user (witness) who witnesses the action notifies the server of the fact that the malicious action is being done. At step2, the collective intelligence avatar is started up, and then monitoring of the place where the malicious action is being done. The collective intelligence avatar successively stores the result of the monitoring in the monitor DB.

At step3, the jury selection module is invoked. At steps4,5and6, the jury selection module selects jurors in accordance with information obtained from the user DB, and then notifies the selected jurors. The jury selection module further sends the result of the monitoring of the place to the users who have become the jurors. At step7, the jurors carry out the Voting, and then send the result of the Voting to the voting control module. At steps8and9, the voting control module receives rating information from the rating control module. Then, in accordance with the result of the Voting, the voting control module executes processing on the user who does the malicious action. At step10, rating information on the users, the related objects, and the related groups is updated, and the result of the update is then sent to the user DB.

FIG. 3shows a sequence diagram of the above-described processing, between the administrative server side and the client side (the malicious actor, the witness, the jurors, and the adjacent avatars).

In addition,FIG. 4shows an example of a layout of databases regarding the users (avatars), the groups, and the possessed objects. In particular,FIG. 4shows a Group Table402, an Avatar Table404and an Object Table406. A Group Relation410relates the Avatar Table to the Group Table, and an Object Relationship410relates the Avatar Table to the Object Table.

In the selection of jurors, used are user information, a rating value, a jury history and the like in an avatar table. The user information includes attribute information in the real world (including an address, an age, gender and the like), which is not described in detail here. In addition, columns for rating values are prepared for each avatar, each object, and each group. The values in the columns are updated by the propagation of rating values.

FIG. 5illustrates a general computer environment500that can be used to implement the virtual world monitoring and voting techniques described herein. The computer environment500is only one example of a computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the computer and network architectures. Neither should the computer environment500be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in the exemplary computer environment500.

Computer environment500includes a general-purpose computing device in the form of a computer502. The components of computer502can include, but are not limited to, one or more processors or processing units504, a system memory506, and a system bus508that couples various system components including the processor504to the system memory506.

The system bus508represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. By way of example, such architectures can include an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, an Enhanced ISA (EISA) bus, a Video Electronics Standards Association (VESA) local bus, and a Peripheral Component Interconnects (PCI) bus also known as a Mezzanine bus.

Computer502typically includes a variety of computer readable media. Such media can be any available media that is accessible by computer502and includes both volatile and non-volatile media, removable and non-removable media.

The system memory506includes computer readable media in the form of volatile memory, such as random access memory (RAM)510, and/or non-volatile memory, such as read only memory (ROM)512. A basic input/output system (BIOS)514, containing the basic routines that help to transfer information between elements within computer502, such as during start-up, is stored in ROM512. RAM510typically contains data and/or program modules that are immediately accessible to and/or presently operated on by the processing unit504.

Computer502may also include other removable/non-removable, volatile/non-volatile computer storage media. By way of example,FIG. 5illustrates a hard disk drive516for reading from and writing to a non-removable, non-volatile magnetic media (not shown), a magnetic disk drive518for reading from and writing to a removable, non-volatile magnetic disk520(e.g., a “floppy disk ” ), and an optical disk drive522for reading from and/or writing to a removable, non-volatile optical disk524such as a CD-ROM, DVD-ROM, or other optical media. The hard disk drive516, magnetic disk drive518, and optical disk drive522are each connected to the system bus508by one or more data media interfaces526. Alternatively, the hard disk drive516, magnetic disk drive518, and optical disk drive522can be connected to the system bus508by one or more interfaces (not shown).

The disk drives and their associated computer-readable media provide non-volatile storage of computer readable instructions, data structures, program modules, and other data for computer502. Although the example illustrates a hard disk516, a removable magnetic disk520, and a removable optical disk524, it is to be appreciated that other types of computer readable media which can store data that is accessible by a computer, such as magnetic cassettes or other magnetic storage devices, flash memory cards, CD-ROM, digital versatile disks (DVD) or other optical storage, random access memories (RAM), read only memories (ROM), electrically erasable programmable read-only memory (EEPROM), and the like, can also be utilized to implement the exemplary computing system and environment.

Any number of program modules can be stored on the hard disk516, magnetic disk520, optical disk524, ROM512, and/or RAM510, including by way of example, an operating system526, one or more application programs528, other program modules530, and program data532. Each of such operating system526, one or more application programs528, other program modules530, and program data532(or some combination thereof) may implement all or part of the resident components that support the distributed file system.

A user can enter commands and information into computer502via input devices such as a keyboard534and a pointing device536(e.g., a “mouse”). Other input devices538(not shown specifically) may include a microphone, joystick, game pad, satellite dish, serial port, scanner, and/or the like. These and other input devices are connected to the processing unit504via input/output interfaces540that are coupled to the system bus508, but may be connected by other interface and bus structures, such as a parallel port, game port, or a universal serial bus (USB).

A monitor542or other type of display device can also be connected to the system bus508via an interface, such as a video adapter544. In addition to the monitor542, other output peripheral devices can include components such as speakers (not shown) and a printer546which can be connected to computer502via the input/output interfaces540.

Computer502can operate in a networked environment using logical connections to one or more remote computers, such as a remote computing device548. By way of example, the remote computing device548can be a personal computer, portable computer, a server, a router, a network computer, a peer device or other common network node, and the like. The remote computing device548is illustrated as a portable computer that can include many or all of the elements and features described herein relative to computer502.

Logical connections between computer502and the remote computer548are depicted as a local area network (LAN)550and a general wide area network (WAN)552. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets, and the Internet.

When implemented in a LAN networking environment, the computer502is connected to a local network550via a network interface or adapter554. When implemented in a WAN networking environment, the computer502typically includes a modem556or other means for establishing communications over the wide network552. The modem556, which can be internal or external to computer502, can be connected to the system bus508via the input/output interfaces540or other appropriate mechanisms. It is to be appreciated that the illustrated network connections are exemplary and that other means of establishing communication link(s) between the computers502and548can be employed.

In a networked environment, such as that illustrated with computing environment500, program modules depicted relative to the computer502, or portions thereof, may be stored in a remote memory storage device. By way of example, remote application programs558reside on a memory device of remote computer548. For purposes of illustration, application programs and other executable program components such as the operating system are illustrated herein as discrete blocks, although it is recognized that such programs and components reside at various times in different storage components of the computing device502, and are executed by the data processor(s) of the computer.

Various modules and techniques may be described herein in the general context of computer-executable instructions, such as program modules, executed by one or more computers or other devices. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Typically, the functionality of the program modules may be combined or distributed as desired in various embodiments.

An implementation of these modules and techniques may be stored on or transmitted across some form of computer readable media. Computer readable media can be any available media that can be accessed by a computer. By way of example, and not limitation, computer readable media may comprise “computer storage media” and “communications media.”

“Computer storage media” includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules, or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer.

“Communication media” typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as carrier wave or other transport mechanism. Communication media also includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media. Combinations of any of the above are also included within the scope of computer readable media.

As will be readily apparent to those skilled in the art, the present invention can be realized in hardware, software, or a combination of hardware and software. Any kind of computer/server system(s)—or other apparatus adapted for carrying out the methods described herein—is suited. A typical combination of hardware and software could be a general-purpose computer system with a computer program that, when loaded and executed, carries out the respective methods described herein. Alternatively, a specific use computer, containing specialized hardware for carrying out one or more of the functional tasks of the invention, could be utilized.

The present invention, or aspects of the invention, can also be embodied in a computer program product, which comprises all the respective features enabling the implementation of the methods described herein, and which—when loaded in a computer system—is able to carry out these methods. Computer program, software program, program, or software, in the present context mean any expression, in any language, code or notation, of a set of instructions intended to cause a system having an information processing capability to perform a particular function either directly or after either or both of the following: (a) conversion to another language, code or notation; and/or (b) reproduction in a different material form.

While it is apparent that the invention herein disclosed is well calculated to fulfill the objects stated above, it will be appreciated that numerous modifications and embodiments may be devised by those skilled in the art, and it is intended that the appended claims cover all such modifications and embodiments as fall within the true spirit and scope of the present invention.