U.S. Pat. No. 7,068,273

DESCRIPTION OF THE PREFERRED EMBODIMENTS

FIG. 1is a block diagram depicting an embodiment of a video game machine to which the 3D image processor of the present invention is applied. In the description below, a home video game machine, which is comprised of a home video game machine connected to a home television, will be described as an example of a video game machine, but the present invention is not limited to this example, but can be applied to a business video game machine as well where the monitor is integrated, and a personal computer which functions as a video game machine by executing the video game program.

The video game machine shown inFIG. 1is comprised of a home game machine100and a home television200. In the home game machine100, a computer readable recording medium300where the video game program, including the 3D image processing program of the present invention and the game data are recorded, is installed, and a game is executed by the video game program and the game data which is read as necessary.

The home game machine100is comprised of a CPU (Central Processing Unit)1(corresponding to a part of the game control means and game image generation means), bus line2, graphics data generation processor3(corresponding to a part of the game image generation means), interface circuit (I/F)4, main memory5, ROM (Read Only Memory)6, expansion circuit7, parallel port8, serial port9, drawing processor10, voice processor11, decoder12, interface circuit13, buffers14–16, recording medium drive17, memory18and controller19. The home television200is comprised of a television monitor21, amplification circuit22and speaker23.

The CPU1is connected to the bus line2and graphics data generation processor3(corresponding to a part of the game image generation means). The bus line2includes an address bus, data bus and control bus, and inter-connects the CPU1, interface circuit4, main memory5, ROM6, expansion circuit7, parallel port8, serial port9, drawing processor10(corresponding to a part of the game image generation means), voice processor11, decoder12, and interface circuit13.

The drawing processor10is connected to the buffer14. The voice processor11is connected to the buffer15and the amplification circuit22. The decoder12is connected to the buffer16and the recording medium drive17. And the interface circuit13is connected to the memory18and the controller19(corresponding to the operation means).

The television monitor21of the home television200is connected to the drawing processor10. The speaker23is connected to the amplification circuit22. In the case of a business video game machine, the television monitor21(corresponding to the display means), amplification circuit22, and the speaker23may be housed in one body along with each block constituting the home game machine100.

When a video game machine is configured with a personal computer or workstation as the core, the television monitor21corresponds to the display for a computer. The expansion circuit7, drawing processor10and voice processor11correspond to a part of the program data recorded in each recording medium300or hardware on the expansion board inserted into the expansion slot of the computer. The interface circuit4, parallel port8, serial port9and interface circuit13correspond to the hardware on the expansion board inserted into the expansion slot of the computer. The buffers14–16correspond to each storage area of each main memory5or expansion memory (not illustrated).

Now each composing element inFIG. 1will be described. The graphics data generation processor3plays the role of coprocessor of the CPU1. In other words, the graphics data generation processor3performs coordinate transformation and light source calculation, such as performing a matrix operation in a fixed point format and a vector operation, by parallel processing.

The major processing executed by the graphics data generation processor3includes processing to determine the address data of the processing target image in a predetermined display area to the CPU1based on the coordinate data, moving amount data and rotation amount data of each vertex of the image data supplied from the CPU1in a two-dimensional or 3D space and to return the address data to the CPU1, and processing to calculate the luminance of images according to the distance from a light source, which is set virtually.

The interface circuit4is used for interfacing peripheral devices, such as a pointing device, including a mouse and track ball. The main memory5is comprised of RAM (Random Access Memory). In the ROM6, the program data to be the operation system of the video game machine has been stored. This program corresponds to BIOS (Basic Input Output System) of the personal computer.

The expansion circuit7performs expansion processing on compressed images compressed by intra-encoding conforming to the MPEG (Moving Picture Experts Group) standard for moving pictures, or JPEG (Joint Photographic Experts Group) for still pictures. The expansion processing includes decoding processing (decoding data encoded by VLC: Variable Length Code), inverse quantization processing, IDCT (Inverse Discrete Cosine Transform) processing, and intra-image recovery processing.

The drawing processor10performs drawing processing for the buffer14based on a drawing instruction which the CPU1issues at each predetermined time T (e.g. T= 1/60 sec. in one frame).

The buffer14is comprised of RAM, for example, and is divided into a display area (frame buffer) and a non-display area. The display area is comprised of a development area for data to be displayed on the display screen of the television monitor21. The non-display area is comprised of a storage area for data to define skeletons, model data to define polygons, animation data for models to move, pattern data to indicate the content of each animation, texture data, and color palette data.

Here texture data is two-dimensional image data. The color palette data is data for specifying the color of texture data. The CPU1records these data in the non-display area of the buffer14in advance from the recording medium300all at once, or in a plurality of times according to the progress status of the game.

The drawing instructions include drawing instructions for drawing a 3D image using polygons and drawing instructions for drawing a regular two-dimensional image. Here a polygon is a polygonal two-dimensional virtual graphic, such as a triangle and a square, for example.

Drawing instructions for drawing a 3D image using polygons are used for polygon vertex address data, which indicates the storage position of the polygon vertex coordinate data on the display area in the buffer14, for texture address data, which indicates the storage position of the texture to be pasted onto polygons in the buffer14, for color palette address data, which indicates the storage position of the color palette data to indicate the color of the texture in the buffer14, and for luminance data which indicates the luminance of the texture.

Out of the above data, the polygon vertex address data on the display area is data created when the polygon vertex coordinate data in the 3D space from the CPU1is coordinate-transformed into the two-dimensional polygon vertex coordinate data by the graphic data generation processor3based on the movement amount data and rotation amount data. The luminance data is determined by the graphics data generation processor3based on the distance from a position indicated by the polygon vertex coordinate data after the above coordinate-transformation provided from the CPU1to the virtually installed light source.

The polygon vertex address data indicates an address in the display area of the buffer14. The drawing processor10performs processing to write the texture data corresponding to the range of the display area of the buffer14indicated by three polygon vertex address data.

An object in the game space, such as a character, is comprised of a plurality of polygons. The CPU1associates the coordinate data of each polygon in the 3D space with the vector data of the corresponding skeletons, and stores it in the buffer14. And when the object is moved on the display screen of the television monitor21by the later mentioned operation of the controller19, the following processing is performed to express the movement of the object or the viewpoint position from which the object is viewed is changed.

To the graphics data generation processor3, the CPU1provides the 3D coordinate data of the vertexes of each polygon, which is held in the non-display area of the buffer14, and the movement amount data and the rotation amount data of each polygon determined from the coordinates of the skeleton and the rotation amount data thereof.

The graphics data generation processor3sequentially determines the 3D coordinate data of each polygon after movement and after rotation based on the 3D coordinate data of the vertexes of each polygon and the movement amount data and rotation amount data of each polygon.

Of the 3D coordinate data of each polygon determined like this, the coordinate data in the horizontal and vertical directions are supplied to the drawing processor10as address data on the display area of the buffer14, that is, as polygon vertex address data.

The drawing processor10writes the texture data indicated by the texture address data which has been allocated on the display area by the buffer14indicated by the three polygon vertex address data. By this, an object comprised of many polygons where texture is pasted is displayed on the display screen of the television monitor21.

A drawing instruction for drawing regular two-dimensional images is used for vertex address data, texture address data, color palette address data, which indicates the storage position of the color palette data to indicate the color of the texture data in the buffer14, and luminance data, which indicates the luminance of the texture. Of these data, the vertex address data is obtained by the graphics data generation processor3, which coordinate-transforms the vertex coordinate data on the two-dimensional plane from the CPU1based on the movement amount data and the rotation amount data from the CPU1.

The voice processor11stores the ADPCM (Adaptive Differential Pulse Code Modulation) data, which is read from the recording medium300, in the buffer15, and the ADPCM data stored in the buffer15becomes the sound source.

The voice processor11reads the ADPCM data from the buffer15based on the clock signal at a 44.1 kHz frequency. The voice processor11performs such processing as converting pitch for the read ADPCM data, adding noise, setting an envelope, setting level, and adding reverberation.

When the voice data read from the recording medium300is PCM (Pulse Code Modulation) data, such as CD-DA (Compact Disk Digital Audio), the voice processor11converts this voice data into ADPCM data. The processing of PCM data by a program is directly executed on the main memory5. The PCM data processed on the main memory5is supplied to the voice processor11, and is converted into ADPCM data. Then various processings mentioned above are executed, and voice is output from the speaker23.

For the recording medium drive17, a DVD-ROM drive, CD-ROM drive, hard disk drive, optical disk drive, flexible disk drive, silicon disk drive, and cassette medium reader, for example, are used. In this case, a DVD-ROM, CD-ROM, hard disk, optical disk, flexible disk and semiconductor memory, for example, are used for the recording medium300.

The recording medium drive17reads image data, voice data and program data from the recording medium300, and supplies the read data to the decoder12. The decoder12performs error correction processing with ECC (Error Correction Code) on the data regenerated from the recording medium drive17, and supplies error corrected data to the main memory5or to the voice processor11.

For the memory18, a card type memory, for example, is used. The card type memory is used for holding various game parameters at the point of interruption, for example, such as the case of holding status at the point of interruption when a game is interrupted.

The controller19is an operation device used for the player to input various operation instructions, and sends an operation signal according to the operation by the player to the CPU1. On the controller19, a first button19a,second button19b,third button19c,fourth button19d,up key19U, down key19D, left key19L, right key19R, L1button19L1, L2button19L2, R1button19R1, R2button19R2, start button19e,select button19f,left stick19SL and right stick19SR are installed.

The up key19U, down key19D, left key19L and right key19R are used for sending commands, to move the object and the cursor vertically and horizontally on the screen of the television monitor21, for example, to the CPU1.

The start button19eis used, for example, for instructing the CPU1to load the game program from the recording medium300. The select button19fis used, for example, for instructing the CPU1to make various selections on the game program which is loading from the recording medium300to the main memory5.

Each button and each key of the controller19, except the left stick19SL and the right stick19SR, is a switch which turns ON if pressed down from the neutral position by an external pressing force, and turns OFF if the pressing force is released, and the button or key returns to the neutral position.

The left stick19SL and the right stick19SR are stick type controllers which configuration is roughly the same as a joy stick. This stick type controller has an upright stick, and can tilt 360°, including to the front, back, left and right, with a predetermined position of the stick as a fulcrum. The left stick19SL and the right stick19SR sends the values of the x coordinate, which is the left and right directions, and the value of the y coordinate in the front and back directions, with the upright position as an origin, to the CPU1via the interface circuit13as operation signals.

The first button19a,second button19b,third button19c,fourth button19d,L1button19L1, L2button19L2, R1button19R1and R2 button19R2are used for various functions according to the game program loaded from the recording medium300.

Now the general operation of the above mentioned video game machine will be described. When the recording medium300is set in the recording medium drive17, if the power switch (not illustrated) is turned ON and power is supplied to the video game machine, the CPU1instructs the recording medium drive17to read the game program from the recording medium300based on the operating system stored in the ROM6. By this, the recording medium drive17reads image data, voice data and program data from the recording medium300. The read image data, voice data and program data are supplied to the decoder12, and error correction processing is performed for each data by the decoder12.

The image data for which error correction processing was performed by the decoder12is supplied to the expansion circuit7via the bus line2. The image data for which the expansion processing is performed by the expansion circuit7is supplied to the drawing processor10, and is written to the non-display area of the buffer14by the drawing processor10. The voice data for which error correction processing was performed by the decoder12is written to the buffer15via the main memory5or the voice processor11. The program data for which error correction processing was performed by the decoder12is written to the main memory5.

Hereafter, the CPU1progresses the video game based on the game program stored in the main memory5and on the content which the player instructs using the controller19. In other words, based on the content which the player instructs using the controller19, the CPU1executes such control as image processing control, voice processing control, and internal processing control.

As image processing control, the calculation of the coordinates of each skeleton from pattern data corresponding to the animation instructed for the objects, the calculation of vertex coordinate data of polygons, the supply of obtained 3D coordinate data and viewpoint position data to the graphics data generation processor3, and the issue of drawing instructions, including address data and luminance data on the display area of the buffer14determined by the graphics data generation processor3, are performed, for example.

As voice processing control, the issue of voice output commands to the voice processor11and the specification of level and reverberation are performed, for example. As internal processing control, computation according to the operation of the controller19is performed, for example.

FIG. 2is a functional block diagram depicting the major sections of the 3D image processor of the present invention. The 3D image processing program of the present invention is recorded in the recording medium300shown inFIG. 1, just like the above mentioned game program, and is loaded onto the main memory5, and while receiving operations which the player performs via the controller19, the CPU1sequentially executes the 3D image processing program on the main memory5, so as to implement the respective functions. The 3D image processor is comprised of a program execution section400, which implements various functions by executing various processing programs, and a storage section500for storing data.

The program execution section400is comprised of a vertex coordinate setting section401(corresponding to the vertex coordinate setting means) for setting the vertex coordinates of each polygon constituting the first and second patches, a combining vertex selection section402(corresponding to the combining vertex selection means) for selecting the vertexes of the combining target polygons from the first and second patches respectively, and a vertex coordinate change section403(corresponding to the vertex coordinate change means) for matching the vertex coordinates of the first patch side and the vertex coordinates of the second patch side for the vertex coordinates of the selected polygons.

The storage section500is comprised of a control point coordinate storage section501for storing the coordinate data of control points which define the free form surface of the first and second patches respectively, and a division number table storage section502for storing a lookup table whereby the division number is uniquely determined depending on the distance between the reference points of the first and second patches and the virtual viewpoint in the virtual 3D space (this table is referred to as the division number table). How the free form surface is defined by control points is described later.

FIG. 3is a table indicating an example of the division number table. When the distance SL between the reference points of the first and second patches and the virtual viewpoint in the virtual 3D space is 1000 meters or less, the division number DN is 10, and as the distance SL increases the division number DN decreases, the division number DN is 4 if the distance SL exceeds 3000 meters. As the distance SL increases, the division number DN decreases, and the number of polygons constituting the patch decreases in proportion to the square of the division number DN as mentioned later, so the deterioration of image quality is prevented, and processing speed is improved.

The vertex coordinate setting section401is comprised of a reference coordinate setting section401a(corresponding to the reference coordinate setting means) for determining the coordinates of the reference points of the first and second patches from the coordinates of the control points stored in the control point coordinate storage section501, a viewpoint position setting section401b(corresponding to the viewpoint position setting means) for setting the position of the virtual viewpoint, a division number deciding section401c(corresponding to the division number deciding means) for determining the division number DN using the division number table stored in the division number table storage section502from the distance between the reference points and the virtual viewpoint, a free form surface generation section401d(corresponding to the free form surface generation means) for generating a free form surface using the control points having coordinate data stored in the control point coordinate storage section501for defining the first and second patches respectively, and a polygon generation section401e(corresponding to the polygon generation means) for generating the vertex coordinates of each polygon constituting the first and second patches by dividing the free form surface, which is generated by the free form surface generation section401dusing the division number DN determined by the division number deciding section401c.

The reference coordinate setting section401ais for determining the coordinates of the center position of a rectangular parallelepiped having edges in the three axis directions of a virtual 3D space where all the control points constituting the patch are included (called a bounding box) which has the smallest volume in the virtual 3D space, as the coordinates of the reference points of the first and second patches.

The viewpoint position setting section401bis for receiving input by the player from the controller19, and for setting the virtual viewpoint position to an appropriate position (e.g. position where the main character, which is the target character operated by the player, is displayed at the center of the field of view) according to the progress of the game.

The division number deciding section401cis for determining the division number DN using the division number table stored in the division number table storage section502based on the distance SL between the reference point and the virtual viewpoint. By using the division number table shown inFIG. 3, the division number DN decreases and the number of polygons constituting the patch decreases as the distance SL between the reference point and the virtual viewpoint increases, so a drop in image quality is prevented, and processing speed improves.

The free form surface generation section401dis for generating the free form surface by a parametric function using control points having coordinate data stored in the control point coordinate storage section501so as to define the first and second patches respectively. For the parametric function, the case of using a Bezier function will be described here. The free form surface obtained by using a Bezier function is called a “Bezier surface”.

If the coordinate of the control point Pi, j(where i=0, 1, . . . M, j=0, 1, . . . N) is Pi, j(xi, j, yi, j, zi, j), then the free form surface S (u, v) is given by the following formula, that is, a product of the polynomial Bmi(u) and Bnj(v) of the two parameters u and v (where 0=u=1, 0=v=1) and the coordinate Pi, j(xi, j, yi, j, zi, j) of the control point Pi, j.

[Formula]S⁡(u,v)=∑i=0m⁢∑j=0n⁢Pi+1,j+1·Bmi⁡(u)·Bnj⁡(v)(⁢1-1⁢)whereBmi⁡(u)=m!i!⁢⁢(m-i)!·ui·(1-u)m-i(⁢1-2⁢)Bnj⁡(v)=n!j!⁢⁢(n-j)!·uj·(1-u)n-j(⁢1-3⁢)

The state of the change of the free form surface S (u, v) along with the change of the coordinate Pi, j(xi, j, yi, j, zi, j) of the control point Pi, jwill be described with reference toFIG. 4andFIG. 5. InFIG. 4andFIG. 5, the number of control points is 16(M=4, N=4), and the coordinate axis is shown at the lower right ofFIG. 4andFIG. 5.FIG. 4is the case when the control points Pi, jare on a same plane, andFIG. 5is the case when the control points Pi, jare not on a same plane. When the control points Pi, jare on a same plane as shown inFIG. 4, the free form surface S (u, v) is a plane which passes through all the control points Pi, j.

When the control points Pi, jare not on a same plane as shown inFIG. 5, the end points (points located at the four corners) of the free form surface S (u, v) match the positions of the control points Pi, j, and the free form surface forms a 3D surface which is determined by the coordinate Pi, j(xi, j, yi, j, zi, j) of the control points Pi, j. For example, the control point P2, 2dislocates in the negative direction of the z axis, so the free form surface S (u, v) also dislocates in the negative direction of the z axis, and the control point P2, 3dislocates in the positive direction of the z axis, so the free form surface S (u, v) also dislocates in the positive direction of the z axis. In this way, the desired shape of the free form surface S (u, v) can be formed by changing the coordinate Pi, j(xi, j, yi, j, zi, j) of the control point Pi, j. Also a more complicated shape of the free form surface S (u, v) can be created by increasing the number of control points Pi, j(at least one of M and N).

The polygon generation section401eis for dividing the free form surface S (u, v) generated by the free form surface generation section401dusing the division number determined by the division number deciding section401cso as to generate the vertex coordinates of each polygon constituting the first and second patches. Specifically, the vertex coordinates of the polygon are generated by setting the parameter values u and v of the free form surface S (u, v) according to the division number DN. For example, if the division number DN is 5, 36 vertex coordinates, which are obtained by substituting a combination of u (=0, 0.2, 0.4, 0.6, 0.8, 1.0) and v (=0, 0.2, 0.4, 0.6, 0.8, 1.0) for the formula (1-1), become the vertex coordinates of the polygon. If a square polygon is used, then the vertex coordinates of 25 (=5×5) polygons are set, and if a triangle polygon is used, the vertex coordinates of 50 (=5×5×2) polygons are set. In other words, the number of polygons is in proportion to the square of the division number DN.

The combining vertex selection section402is for selecting the vertexes of the combining target polygons from the first and second patches respectively. For example, when the patch PM1at the left and the patch PM2at the right, shown inFIG. 12, are combined, the vertexes PV101–PV110are selected as the vertexes of the combining target polygons from the patch PM1, and the vertexes PV201–PV208are selected as the vertexes of the combining target polygons from the patch PM2.

The vertex coordinate change section403is for matching the vertex coordinates of the combining target polygons in the first patch with the vertex coordinates of the combining target polygons in the second patch when the number of vertexes of the combining target polygons in the first patch is more than the number of vertexes of the combining target polygons in the second patch. For example, when the patch PM1at the left and the patch PM2at the right, shown inFIG. 12, are combined, the coordinates of the vertexes PV101–PV110of the patch PM1are matched with the coordinates of the vertexes PV201–PV208of the patch PM2.

FIG. 6is a flow chart depicting an example of the vertex coordinate change processing performed by the vertex coordinate change section403. Here the case when the vertexes P1i(i=0, 1, . . . H) of the polygons constituting the first patch and the vertexes P2j(j=0, 1, . . . K) constituting the second patch are combined will be described. Here it is assumed that the number of vertexes H of the combining target polygons i n the first patch is more than the number of vertexes K of the combining target polygons in the second patch. The coordinates of the vertex P1iare (P1xi, P1yi, P1zi), and the coordinates of the vertex P2jare (p2xj, P2yj, P2zj).

At first, the adjustment factor α for adjusting the difference of the number of vertexes is obtained by dividing the number of vertexes K by the number of the vertexes H (step ST1). Then the counter h is initialized to 0 (step ST3). And the counter h is multiplied by the adjustment factor α and the integer part of the result is set to the counter k (step ST5). Then the coordinates of the vertex P2kare changed to the coordinates of the vertex P1h(step ST7). And it is judged whether the counter h is less than the number of vertexes H (step ST9). If the result of this judgment is “Yes”, then the counter h is incremented (step ST11), and processing returns to step ST5. And if the result of this judgment is “Yes”, processing ends.

FIG. 7is a diagram depicting an example of the result when the vertex coordinate change processing, shown inFIG. 6, was performed to combine two patches with a different number of polygons (number of vertexes of polygons), shown inFIG. 12. InFIG. 7, when the patch PM1at the left and the patch PM2at the right are combined, there are ten combining target vertexes, PV101–PV110, in the patch PM1, and there are eight combining target vertexes, PV201–PV208, in the patch PM2, so in the vertex coordinate change processing to be executed by the vertex coordinate change section403, the coordinates of the combining target vertexes PV101–PV110in the patch PM1inFIG. 12are changed so as to match with the combining target vertexes PV201–PV208in the patch PM2. In other words, for the combining target vertexes, PV101–PV110, in the patch PM1inFIG. 12, the vertex coordinates thereof are changed so that the positions of the vertexes come to the positions of the vertexes PV101D–PV110D inFIG. 7. As a result, the patch PM1and the patch PM2are combined while preventing the generation of clearance.

FIG. 8is a diagram depicting an example of the clearances which are generated when eight patches and one object are combined. InFIG. 8, as a result of combining the patches PM3–PM10and the object OBJ, the clearances CL2–CL6are generated at the combining sections where the division number is different between the patches (or patch and object) to be combined.

FIG. 9is a diagram depicting an example of the result when the image processing of the present invention is performed to combine the eight patches and one object shown inFIG. 8. InFIG. 9, for the patch (or object) which has a higher number of combining target vertexes, the vertex coordinates thereof are changed so that the positions of the vertexes come to the positions of the vertexes of the patch (or object) which has a lower number of combining target vertexes. For example, for the edge at the upper left of the patch PM3, the number of vertexes to be combined with the patch PM10is 5, and for the edge at the lower right of the patch PM10, the number of vertexes to be combined with the patch PM3is 7, so the vertex coordinates are changed so that the positions of the vertexes for the edge at the lower right of the patch PM10to be combined with the patch PM3match with the positions of the vertexes for the edge at the upper left of the patch PM3to be combined with the patch PM10. As a result, the patches or the patch and the objects are combined while preventing the generation of clearances.

FIG. 10is a diagram depicting an example of a screen which is formed by pasting texture on the polygons constituting the patch and object shown inFIG. 8. Since clearances are generated at the section combining patches (or patch and object) having a different division number, image quality and reality thereof drop.

FIG. 11is a diagram depicting an example of a screen which is formed by pasting texture on the polygons constituting the patch and object shown inFIG. 9. Since the patches or patch and object are combined while preventing the generation of clearances, image quality and reality thereof are improved.

The present invention may have the following aspects.

(A) In the present embodiment, the case when the vertex coordinates of polygons constituting the patch are generated by the polygon generation section was described, but the vertex coordinates may be stored in such a storage means as ROM or CD-ROM of the computer, and be read from the storage means. In this case, the load on the CPU is decreased.

(B) In the present embodiment, the case when the reference point of the free form surface to be used for determining the division number of the free form surface is the center point of the bounding box was described, but another point, such as one of the control points for forming the free form surface, may be used.

(C) In the present embodiment, the case when the free form surface is generated by a Bezier function was described, but another function, such as a Spline function, NURBS (Non-Uniform Rational B-Spline) function, and a Sub Division Surface function, may be used.

(D) In the present embodiment, the case when the division number of the free form surface is determined using a lookup table was described, but the division number may be determined using a predetermined computing equation

(E) In the present embodiment, the case when two patches are combined was described, but two objects or an object and a patch may be combined.

(F) In the present embodiment, the case when the vertex coordinates of the combining target vertexes are changed was described, but at least another vertex information, such as the vertex color, vertex texture coordinates, and vertex normal vectors, may be changed, in addition to the vertex coordinates. However, if two patches, two objects, or a patch and an object to be combined have mutually different material information (e.g. ambient color, diffuse color, specular color, texture information), it is preferable not to change the vertex texture coordinates, since more natural images can be created.

In summary, this invention relates to a recording medium which stores a 3D image processing program for combining a first and second patches which are comprised of a plurality of polygons respectively. The 3D image processing program stored in the recording medium causes a computer to function as vertex coordinate setting means for setting the vertex coordinates of each polygon constituting the first and second patches, combining vertex selection means for selecting the vertexes of combining target polygons from the first and second patches respectively, and vertex coordinate change means for matching the vertex coordinates of the first patch side and the vertex coordinates of the second patch side for the vertex coordinates of the selected polygons.

According to the above invention, the vertex coordinate setting means sets the vertex coordinates of each polygon constituting the first and second patches, the combining vertex selection means selects the vertexes of the combining target polygons from the first and second patches respectively, and the vertex coordinate change means changes the vertex coordinates so that the vertex coordinates of the first patch side and the vertex coordinates of the second path side match for the vertex coordinates of the selected polygons. By matching the vertex coordinates of the combined target polygons of the first and second patches, the clearance between the first and second patches is combined as if it seamed, and the image quality of the images created by combining the first and second patches and the reality thereof are improved.

In the aforementioned 3D image processing program, it is preferable that when the number of vertexes of the combining target polygons in the first patch is more than the number of vertexes of the combining target polygons in the second patch, the vertex coordinate change means matches the vertex coordinates of the combining target polygons in the first patch with the vertex coordinates of the combining target polygons in the second patch.

According to the above invention with the aforementioned feature, when the number of vertexes of the combining target polygons in the first patch is more than the number of vertexes of the combining target polygons in the second patch, the vertex coordinates are changed by the vertex coordinate change means so that the vertex coordinates of the combining target polygons in the first patch match with the vertex coordinates of the combining target polygons in the second patch. In other words, the vertex coordinates of the combining target polygons in the patch which has a higher number of vertexes match with the vertex coordinates of the combined target polygons in the patch which has a less number of vertexes, so the patches can be easily combined without increasing the number of vertexes (increasing the number of polygons).

In the aforementioned 3D image processing program, wherein the vertex coordinate setting means preferably include free form surface generation means for generating a free form surface using control points having coordinate information which has been prepared for defining the first and second patches, and polygon generation means for generating the vertex coordinates of each polygon constituting the first and second patches by dividing the generated free form surface by a predetermined division number for dividing the free form surface.

According to the invention as described above, the free form surface generation means generates a free form surface using control points having coordinate information which has been prepared to define the first and second patches respectively, and the polygon generation means divides the generated free form surface using a predetermined division number for dividing the free form surface, and generates the vertex coordinates of each polygon constituting the first and second patches. Therefore the computer stores the coordinate information on the control points, which is less than the vertex coordinates of the polygons, so the required storage capacity is decreased compared with the case when the vertex coordinates of each polygon constituting the first and second patches are stored in advance.

Moreover, in the 3D image processing program, the vertex coordinate setting means includes viewpoint position setting means for setting the position of a virtual viewpoint, and division number deciding means for determining the division number using the virtual viewpoint position information, and the polygon generation means generates the vertex coordinates of polygons using the determined division number.

According to the invention with the above features, the viewpoint position setting means sets the position of the virtual viewpoint, and the division number deciding means determines the division number using the virtual viewpoint position information. And the polygon generation means generates the vertex coordinates of the polygons using the determined division number. By decreasing the division number as the patch becomes further away from the position of the virtual viewpoint, the drop in image quality is controlled, and the processing speed can be improved.

Furthermore, in the 3D image processing program, wherein the vertex coordinate setting means preferably includes reference coordinate setting means for setting the respective coordinates of the reference points of the first and second patches, and the division number deciding means determines the division number based on the distance between the reference point and the virtual viewpoint.

According to the invention with the above features, the reference coordinate setting means sets the respective coordinates of the reference points of the first and second patches, and the division number deciding means determines the division number based on the distance between the reference point and the virtual viewpoint, so an appropriate division number is easily determined.

Furthermore, in the 3D image processing program, wherein the division number deciding means determines the division number using a lookup table whereby the division number is uniquely determined depending on the distance between the reference point and the virtual viewpoint.

According to the invention with the above features, the division number is uniquely determined from the distance between the reference point and the virtual viewpoint via the lookup table, so an appropriate division number can be determined even more easily.

Yet moreover, in the 3D image processing program, wherein the division number deciding means determines the division number by a predetermined computing equation using the distance between the reference point and the virtual viewpoint.

According to the invention with the above features, the division number is determined from the distance between the reference point and the virtual viewpoint by a computing equation, so an even more appropriate division number can be determined.

The present invention also relates to a recording medium which stores a 3D image processing program for combining a first and second objects which are comprised of a plurality of polygons respectively, the 3D image processing program causes a computer to function as vertex coordinate setting means for setting the vertex coordinates of each polygon constituting the first and second objects, combining vertex selection means for selecting the vertexes of the combining target polygons from the first and second objects respectively, and vertex coordinate change means for matching the vertex coordinates of the first object side and the vertex coordinates of the second object side for the vertex coordinates of the selected polygons.

According to the aforementioned form of the invention, the vertex coordinate setting means sets the vertex coordinates of each polygon constituting the first and second objects, the combining vertex selection means selects the vertexes of the combining target polygons from the first and second patches respectively, and the vertex coordinate change means changes the vertex coordinates so that the vertex coordinates of the first object side and the vertex coordinates of the second object side match for the vertex coordinates of the selected polygon. By matching the vertex coordinates of the combining target polygons of the first and second objects, the clearance between the first and second objects is combined as if seamed, and the image quality of the images created by combining the first and second patches and the reality thereof are improved.

With the above described form of the invention, the 3D image processing program stored in the recording medium for combining an object and a patch which are comprised of a plurality of polygons respectively, which makes a computer function as vertex coordinate setting means for setting the vertex coordinates of each polygon constituting the object and patch, combining vertex selection means for selecting the vertexes of the combining target polygons from the object and patch respectively, and vertex coordinate change means for matching the vertex coordinates of the object side and the vertex coordinates of the patch side for the vertex coordinates of the selected polygons.

According to the above invention, the vertex coordinate setting means sets the vertex coordinates of each polygon constituting the object and patch, the combining vertex selection means selects the vertexes of the combining target polygons from the object and patch respectively, and the vertex coordinate change means changes the vertex coordinates so that the vertex coordinates of the object side and the vertex coordinates of the patch side match for the vertex coordinates of the selected polygon. By matching the vertex coordinates of the combining target polygons of the object and the patch, the clearance between the object and the patch is combined as if seamed, and the image quality of the image created by combining the first and second patches and the reality thereof are improved.

Moreover, the present invention relates to a 3D image processor for combining a first and second patches which are comprised of a plurality of polygons respectively, comprising vertex coordinate setting means for setting the vertex coordinates of each polygon constituting the first and second patches, combining vertex selection means for selecting the vertexes of the combining target polygons from the first and second patches respectively, and vertex coordinate change means for matching the vertex coordinates of the first patch side and the vertex coordinates of the second patch side for the vertex coordinates of the selected polygons.

According to the above invention, the vertex coordinate setting means sets the vertex coordinates of each polygon constituting the first and second patches, the combining vertex selection means selects the vertexes of the combining target polygons from the first and second patches respectively, and the vertex coordinate change means changes the vertex coordinates so that the vertex coordinates of the first patch side and the vertex coordinates of the second patch side match for the vertex coordinates of the selected polygons. By matching the vertex coordinates of the combining target polygons of the first and second patches, the clearance between the first and second patches is combined as if seamed, and the image quality of the images created by combining the first and second patches and the reality thereof are improved.

The present invention also relates to a 3D image processing method for combining a first and second patches which are comprised of a plurality of polygons respectively, which makes a computer execute vertex coordinate setting processing for setting the vertex coordinates of each polygon constituting the first and second patches, combining vertex selection processing for selecting the vertexes of the combining target polygons from the first and second patches respectively, and vertex coordinate change processing for matching the vertex coordinates of the first patch side and the vertex coordinates of the second patch side for the vertex coordinates of the selected polygons.

According to the above form of the invention, the vertex coordinates of each polygon constituting the first and second patches are set in the vertex coordinate setting processing, the vertexes of the combining target polygons are selected from the first and second patches respectively in the combining vertex selection processing, and the vertex coordinates are changed in the vertex coordinate change processing so that the vertex coordinates of the first patch side and the vertex coordinates of the second patch side match for the vertex coordinates of the selected polygons. By matching the vertex coordinates of the combining target polygons of the first and second patches, the clearance between the first and second patches is combined as if seamed, and the image quality of the images created by combining the first and second patches and the reality thereof are improved.

In addition, the present invention relates to a video game machine comprising operation means for receiving input from the outside, game progress control means for controlling the progress of a game based on the input from the outside, game image generation means for generating game images corresponding to the progress of the game in a virtual 3D space, and display means for displaying game images, wherein the game image generation means includes vertex coordinate setting means for setting the vertex coordinates of each polygon constituting a first and second patches, combining vertex selection means for selecting the vertexes of the combining target polygons from the first and second patches respectively, and vertex coordinate change means for matching the vertex coordinates of the first patch side and the vertex coordinates of the second patch side for the vertex coordinates of the selected polygons.

According to the above invention, the operation means receives input from the outside, the game progress control means controls the progress of the game based on the input from the outside, the game image generation means generates game images corresponding to the progress of the game in a virtual 3D space, and the display means displays game images. And when the game image generation means generates the game images corresponding to the progress of the game in the virtual 3D space, the vertex coordinate setting means sets the vertex coordinates of each polygon constituting the first and second patches, the combining vertex selection means selects the vertexes of the combining target polygons from the first and second patches respectively, and the vertex coordinate change means changes the vertex coordinates so that the vertex coordinates of the first patch side and the vertex coordinates of the second patch side match for the vertex coordinates of the selected polygons. By matching the vertex coordinates of the combining target polygons of the first and second patches, the clearance between the first and second patches is combined as if seamed, and the image quality of the images created by combining the first and second patches and the reality thereof are improved.

This application is based on Japanese patent application serial no. 2002-18925, filed in Japan Patent Office on Jan. 28, 2002, the contents of which are hereby incorporated by reference.

Although the present invention has been fully described by way of example with reference to the accompanying drawings, it is to be understood that various changes and modifications will be apparent to those skilled in the art. Therefore, unless otherwise such changes and modifications depart from the scope of the present invention hereinafter defined, they should be construed as being included therein.