Source: Hong Kong Government special administrative region
Following is a question by the Hon Tommy Chung and a written reply by the Secretary for Innovation, Technology and Industry, Professor Sun Dong, in the Legislative Council today (July 15):
Question:
(1) A token is the basic unit used by AI systems to process text, and is commonly used to reflect data processing volume and the related demand for computing power. Currently, government departments, scientific research institutions and enterprises directly procure services from local, Mainland or overseas suppliers based on their business needs. Their token consumption data is scattered across different platforms and proprietary networks. As a unified standard for the calculation method of tokens when different models process the same text has yet to be established in the global AI industry, the Government currently has no statistics or projections on the local daily average token consumption and capacity.