The N0va Desktop Team Under the Iceberg

This article contains AI-generated translation.

 Author
 Published

你关于鹿鸣的印象，是什么样的？
What is your impression of Lumi?

2020年5月，鹿鸣发布了首支视频投稿作品。截止到目前，鹿鸣已经有24支视频作品，进行了3场直播，换了更多的发型和套装，尝试了更酷炫的舞蹈……
In May 2020, Lumi released their first video submission. Up to now, Lumi has produced 24 video works, held 3 live broadcasts, changed hairstyles and outfits multiple times, and attempted more cool and stunning dances...

在这些视频、直播的背后，鹿鸣的技术力都发生了哪些变化？在直播之外，鹿鸣团队又在做些什么呢？
Behind these videos and live broadcasts, what changes have occurred in Lumi's technical skills? Besides live broadcasting, what else is the Lumi team working on?

今天我们邀请了几位鹿鸣团队的同学，和大家聊一聊鹿鸣那些“冰山下的故事”。
Today, we invited several members of the Lumi team to chat with everyone about the "stories under the iceberg" of Lumi.

Q：直播前一个小时心情怎么样？
How do you feel an hour before the live broadcast?

A：直播需要操作人员有一颗强大的心脏。
Live broadcasts require the operators to have a strong heart.

比如我是幕后负责技术的，到直播最后关头，为了确保流程稳定性，也不敢贸然再修改代码，但是现场的操作同学需要精准完成各项复杂的操作，才能确保直播顺利进行。
For example, I am responsible for the technical aspects behind the scenes. As we approach the end of the live broadcast, to ensure the stability of the process, I dare not make any more code modifications. However, the operators on-site need to accurately perform various complex operations to ensure the smooth progress of the live broadcast.

例如需要根据节奏切换镜头，提升观众的整体观看体验，这对于临场应变能力要求是很高的。
For instance, switching camera angles according to the rhythm to enhance the overall viewing experience for the audience requires a high level of adaptability.

还记得第二次直播遇到过一个问题，在开播前5分钟，19:55的时候，由于紧张误操作多按了个回车，机器暂停工作，所有的管线都停止了。
I still remember encountering a problem during the second live broadcast. Five minutes before the start, at 19:55, due to nervousness, I made a mistake and accidentally pressed the Enter key multiple times, causing the machine to pause, and all the pipelines stopped.

只剩5分钟，说实话，我心里挺慌的，但是现场的同学很沉着冷静，和大家说“没事，我们从头检查一遍。” 很幸运的是，那是第一个环节，我们很快就发现了问题所在并调整更新。20点整，直播正常播出。
With only 5 minutes left, to be honest, I was quite flustered, but the on-site team remained calm and said, "It's okay, let's check everything from the beginning." Luckily, it was the first step, and we quickly identified and adjusted the issue. At exactly 20:00, the live broadcast proceeded as normal.

随着直播流程越来越成熟，我就不会感到很紧张了，比如这次，直播前一小时我还在健身。
As the live broadcast process became more mature, I no longer feel very nervous. For example, this time, an hour before the live broadcast, I was still working out.

Q：鹿鸣的短视频表现效果不错，为什么会想到做直播呢？
Lumi's short video performance is excellent. Why did you decide to do live broadcasts?

A：最开始给鹿鸣制作的内容是以短视频为主，大多在10s-30s。
Initially, we focused on creating short videos for Lumi, mostly lasting between 10 to 30 seconds.

视频从开始筹备到发布，一般需要一个多月甚至更多的时间，虽然品质细节抠得很细，但是无法快速更新内容。
The process of preparing and releasing a video typically took more than a month, or even longer. Although we paid great attention to quality and details, we couldn't update content quickly.

其实视频已经能够实现我们预期的效果了，但是我们就在想，有没有可能，我们能够实时或者以很短的周期达到视频这样的效果？如果能够实现，把整个技术管线投入到实际生产中，我们生产内容的效率将会大大提升。
In fact, the videos already achieved the expected results. However, we wondered if it was possible to achieve real-time or short-cycle effects similar to videos. If we could achieve this, and integrate the entire technological pipeline into actual production, the efficiency of content creation would be greatly improved.

如果我们能实时生产高质量内容，那么游戏动画就不再需要动画师反复修一个月，工业化管线将被优化到一个非常高的效率。在某种意义上，这是一个颠覆性的改变。
If we could produce high-quality content in real-time, then game animations would no longer require animators to spend a month revising them repeatedly. The industrial pipeline would be optimized to a highly efficient level. In a way, it would be a revolutionary change.

Q：鹿鸣三次直播以来，发生了什么变化？
What changes have occurred since Lumi's three live broadcasts?

A：第一次直播，鹿鸣的服装比较简单和贴身，如果衣服比较复杂的话，服装和身体的碰撞会很多，大大增加解算的难度和服务器的压力，效率上也很难达到要求。
During the first live broadcast, Lumi's costumes were relatively simple and close-fitting. If the clothes were more complex, there would be a lot of collision between the clothing and the body, greatly increasing the difficulty of calculation and the server's load, making it difficult to achieve the desired efficiency.

随着后续实时解算技术的不断探索和迭代，鹿鸣直播的发丝实时物理模拟和布料解算都有了更加真实自然的效果，例如鹿鸣的头发和衣服、身体发生各种碰撞也不会穿插。
With continuous exploration and iteration of real-time calculation technology, Lumi's live broadcasts now feature more realistic and natural hair physics simulation and cloth calculation. For example, collisions between Lumi's hair, clothing, and body are no longer intrusive.

同时，鹿鸣也尝试了更多风格的服装，甚至在后面两次直播中突破了实时换装和多次换装的技术点，无论是T恤还是裙子，都有很自然的呈现效果。看似挺平常的一个操作，其实背后投入的人力和算力都是成倍的。
At the same time, Lumi has also tried more styles of clothing. Even in the following two live broadcasts, we broke through the technical points of real-time costume changes and multiple costume changes. Whether it's a T-shirt or a dress, the presentation effect is very natural. Although it may seem like a common operation, the human and computational resources invested behind it are multiplied.

鹿鸣的美术风格也是一个比较大的挑战，我们希望让鹿鸣这个角色具有足够的物理真实，同时又不破坏她特有的风格化形象和渲染效果。
Lumi's artistic style is also a significant challenge. We want Lumi to have enough physical realism while preserving her unique stylized image and rendering effects.

从鹿鸣的表情到肌肉模拟，一开始就都是按照真实人体的解剖逻辑来开发的，然后再根据鹿鸣的风格做调整。找到一个这样的平衡点非常难，我们目前也还一直处在探索的阶段。
From Lumi's facial expressions to muscle simulation, we initially developed them according to the anatomical logic of real human bodies and then adjusted them based on Lumi's style. Finding such a balance point is very challenging, and we are still in the exploratory stage.

Q：如果同学想加入直播团队，你觉得哪些素质和能力是必须的？
If someone wants to join the live broadcast team, what qualities and abilities do you think are necessary?

A：第一点，同学们需要具有过硬的专业知识和技能。以绑定组为例，同学们不仅需要深入理解人体解剖学、人体运动学和相关的3D数学知识，还需要拥有能够不断优化绑定方案，并逐步将其转化为工业化流程和工具的能力。
Firstly, students need to have strong professional knowledge and skills. Take the rigging team as an example; students not only need to have a deep understanding of human anatomy, biomechanics, and relevant 3D mathematics but also the ability to continuously optimize rigging solutions and gradually transform them into industrial processes and tools.

第二点，同学们需要具有良好的沟通和团队协作能力。鹿鸣项目是由多个不同的美术和技术组共同合作完成的。在开发过程中，每个同学每天不仅需要和自己组内同学进行沟通，更需要能够跨组频繁地沟通和协作。因此，在鹿鸣项目中，沟通协作的能力非常重要。大家不要担心说错话，问错问题，我们非常期待听到大家的声音。
Secondly, students need to have excellent communication and teamwork skills. The Lumi project is a collaboration between different art and technical teams. During the development process, each student needs to communicate not only with their own team but also frequently collaborate across teams. Therefore, communication and collaboration skills are vital in the Lumi project. Don't worry about saying or asking the wrong thing; we look forward to hearing everyone's voices.

Q：能简单介绍一下鹿鸣的AI团队在做什么吗？
Can you briefly introduce what the Lumi AI team is working on?

A：我所参与的AI研究主要是聚焦在游戏上的，团队里的其他小伙伴也在探索更多的AI方向。
The AI research I am involved in mainly focuses on games, while other team members are exploring various AI directions.

Q：能举一个我们已经应用AI的例子吗？
Can you give an example of how we have already applied AI?

A：比如《崩坏：星穹铁道》的活动 “无尽的三月七”，大家上传一张照片之后，AI能够将图片转变成三月七的风格。使用过Midjourney和NovelAI的同学可能有感触，让AI生成一张图片并不难，但要让AI生成符合特定风格的图就不那么容易了，我们需要调教模型和参数，让AI能够准确Get到三月七的特征。
For example, in the event "Endless March 7th" in *Honkai: Star Rail*, when players upload a photo, AI can transform the image into the style of March 7th. Students who have used Midjourney and NovelAI might have experienced this. Making AI generate an image is not difficult, but making it generate an image in a specific style is not so easy. We need to fine-tune the models and parameters so that AI can accurately capture the characteristics of March 7th.

Q：团队氛围是什么样的呢？
What is the team atmosphere like?

A：大家在聊日常话题的时候，很容易类比到一些跟技术相关的东西。
During our daily conversations, it's easy for everyone to draw analogies to things related to technology.

比如说看到雨滴落在地面上逐渐密集的过程，同学A会类比到 uniform sampler（均匀采样），认为雨滴也是随机地分布在地面上；进而，同学B想到 scatter（溅射效果），认为雨滴与地面相互作用时也会产生不规则的溅射，仿佛在各个方向上散开；随后，同学C提到了 diffusion（传播扩散），因为随着雨势增大，雨滴开始在地面上形成不同程度和范围的湿润效果。
For example, seeing raindrops gradually intensify when falling to the ground, student A might relate it to uniform sampler (uniform sampling), thinking that raindrops are also randomly distributed on the ground. Then, student B might think of scatter (splash effect), believing that raindrops interacting with the ground will produce irregular splashes, scattering in various directions. Subsequently, student C may mention diffusion (propagation and spread), because as the rain intensifies, the raindrops start to create different degrees and ranges of wet effects on the ground.

我们的群聊里经常会有行业前沿的技术动态讨论，无论是有趣好玩的新应用、还是干货满满的论文，都是我们关注和好奇的对象。在日常工作中，我们的氛围也很开放，不限制大家的脑洞，非常期待对AI感兴趣的同学加入我们，一起探索更多的技术可能。
In our group chats, we often discuss cutting-edge technology trends, including interesting and fun new applications, as well as insightful research papers. These are the subjects we pay attention to and are curious about. In our daily work, the atmosphere is also very open, allowing everyone's creativity to flow freely. We are eager to welcome students interested in AI to join us and explore more technological possibilities together.

Q：在鹿鸣团队做游戏支持，会有哪些不一样呢？
What sets game support in the Lumi team apart?

A： 游戏支持的研究方向更偏DCC软件（比如3D Max、Maya）和引擎相关的开发，来实现一些游戏中会用到的技术，并且让开发更有效率。
Game support focuses more on development related to DCC software (such as 3D Max, Maya) and engines to implement technologies used in games and make development more efficient.

Q：做游戏支持，会有哪些比较有挑战的事情呢？
What are some challenging aspects of working in game support?

A：我们在做的一部分工作是业界很少有人去做，或者也没有看到其他人在做的技术研究。有的可能乍一看都完全没有任何头绪，但随着我们深入做下去，会发现这个事情越来越有可能实现，甚至已经超出了我们最开始的预期。当技术最终应用到游戏中的时候，会感到一种巨大的成就感。
Some of the work we do is rarely pursued by the industry or hasn't been seen as a technological research area. Initially, some projects may seem completely unclear, but as we delve deeper, we discover that they become more feasible, even exceeding our initial expectations. When the technology is eventually applied in games, it brings a tremendous sense of achievement.

Q： 有哪些游戏支持团队的技术应用的例子吗？
Can you provide examples of the technical applications of the game support team?

A：我们做过一套飘带制作相关的工具，叫做“风格化飘带解算”，它可以提高美术同学制作人物和场景里飘带的效率和质量，比如裙摆、头发和一些挂件。
We created a set of tools related to ribbon production, called "Stylized Ribbon Solver." It improves the efficiency and quality of creating ribbons for characters and scenes, such as skirts, hair, and other accessories.

面对不同的游戏或者同一个游戏的不同需求，我们往往会提供更多的定制化方案，比如“骨骼反算”的飘带技术，目前已经在部分游戏的PV制作和过场动画中使用了。
Facing different game requirements or the same game with different demands, we often offer more customized solutions. For example, the "bone inverse solver" ribbon technology is already used in PV production and cutscenes of some games.

Q：如果同学想加入游戏支持团队，你觉得哪些素质和能力是必须的？
If someone wants to join the game support team, what qualities and abilities do you think are necessary?

A：第一点是怀有对技术的热情，只有这样才能有不断学习的动力，再经过一些项目的历练和正反馈，才能更高效地推进项目落地，同时也让自己获得成就感和成长。
Firstly, they need to have a passion for technology. Only with this drive can they continue learning, gain experience from projects, and efficiently advance projects, resulting in a sense of accomplishment and personal growth.

第二点要有工程意识，很多事情不像设想的那么简单，只有实际去做的时候才会发现更多的问题，然后一一解决。当然，做项目也需要有一定的沟通能力，并不是一味地做技术和编程就可以了，这也是非常重要的。
Secondly, having an engineering mindset is crucial. Many things are not as simple as they may seem in theory, and it's only when you actually do them that you encounter more problems and work to solve them. Effective project execution also requires good communication skills; it's not solely about technical expertise and programming. Communication is vital.

看完这些，你是否对鹿鸣团队有了更全面的认识呢？
After reading all this, do you have a more comprehensive understanding of the Lumi team?

除了持续实现技术突破的鹿鸣直播，你是否也对不断挑战未知领域的游戏支持，和探索更多技术可能性的AI团队有所向往呢？
Apart from the continuous technological breakthroughs in Lumi's live broadcasts, do you also have aspirations for the game support team, which challenges unknown fields, and the AI team exploring more technological possibilities?

如果你心动了，就快参照下面的岗位图向鹿鸣团队投出你的简历吧！
If you feel inspired, refer to the position chart below and submit your resume to the Lumi team!