Categories
contextual-theoretical-studies-2 Uncategorised

Week 11

Final work

Creating and Immersing Communication

In the last few years, Artificial Intelligence (AI) has evolved beyond all expectations. Nearly every once in a while there are new changes and even innovations, from the very beginning when AI could only carry out basic conversations, to the creation of literature and the production of pictures and even the simulation of personalities to communicate with people, and these rapid developments have led to the idea of whether AI can be used in other areas and the new changes it can bring. For example, based on the unique immersion of virtual reality and the properties of AI, can the combination of using it together further explore more ideas of VR as a mental health treatment. Whether it is possible to give more solutions to other psychological problems or better help patients, using AI in a virtual environment will be able to help them. Based on this idea most of all the very first starting point, a research and discussion of information on the use of AI in virtual reality environments to help alleviate psychological problems began.

Based on previous understanding and further thinking about how to use and how to improve exposure therapy for phobias in virtual reality, a more focussed effort began to look at other psychological problems in relation to virtual reality and AI. Based on this research into two new psychological problems began. The first psychological problem is called autism. According to the information from Baron‐Cohen, S. (2009), the symptoms of autism, also known as autistic disorder, can basically roughly be characterized by an overactive visual memory, hypersensitivity to the environment, the patient’s self-control is often affected by fear, or their linguistic talent is for some reason extremely weak. They usually have communication or social interaction difficulties and lack interest and social skills. This problem is largely untreatable through medication, but only through communication and other exercises to help the patient develop the appropriate skills, but they often refuse to communicate with others because of this lack of interest. Another type of psychological problem is called depression. Let’s talk facts about depression – PPCN. (2015) shows that it occurs mainly due to the fact that the patient has received a great deal of mental stress or obstacles in life. Usually, during a depressive episode, the patient may experience a lot of emotions such as sadness, irritability, emptiness and other negative emotions, which may cause them to feel a loss of pleasure or interest in activities or a gradual refusal to communicate with other people. For this problem the patient can try to alleviate the situation by talking to their doctor, which is also known as talk therapy. However, according to this resource by Cronin, C.J., Forsstrom, M.P. and Papageorge, N.W. (2020). Many patients do not prefer this type of therapy. This is mainly due to the fact that it takes longer to work and is more expensive, but more importantly, many people have prejudices about the effectiveness of the treatment, or they have an aversion to discussing personal or painful issues with strangers.

Based on these studies, an idea gradually emerged. Could the role of the doctor in talking therapies be replaced by artificial intelligence, or could it simply be a person for these people to talk to and communicate with. In order to investigate the feasibility of this, a study on how and how well AI communicates with its users was started. Firstly, this study by Eysenbach, G., Publications, J. and Eysenbach, C.A. (2023) and another study by Sundar, S.S. and Lee, E.-J. (2022) provide and confirm the feasibility of AI as a means of communicating with people and building language models to better simulate personalities, although it also suggests that AI may make some unpredictable errors in communication. For while this study by Berşe, S. et al. (2023), which shows more about the potential benefits and limitations of AI chatbots. While it can quickly pick up expertise and make quick judgements based on conversations, it can also have issues with providing inaccurate or biased information, as well as its most worrying collection of personal information.

Based on this evidence and data, the question arises as to whether or not it is possible, as well as the advantages and disadvantages, to use AI in virtual reality to help patients with autism or depression who can be relieved through communication and exchange. Firstly, it is true that understanding autism or depression can continue to help patients by easing their moods and states through communication and interaction. But the problem arises that they may not want to communicate well and effectively with certain people or contact them out of fear or other emotions, or they may only want to communicate with certain people, all because they don’t trust the person they are communicating with. This is where the benefits of AI as a communication object come into play from this idea, the controllability of the AI and the level of training of the language model can go a long way in helping the communicator to trust them. In terms of controllability, the user can change or control how the AI communicates with him/her in a better and more comfortable way, such as taking the initiative to change the AI’s preset personality and language model, to change the AI’s language model by giving a positive or negative comment on a certain sentence or a certain response from the AI, or in other ways to make the AI’s language model more suitable for the user’s personality and way of speaking, so that the AI has the user’s trust in it. The AI can also judge the user’s mental state by detecting the emotions or specific words in the user’s spoken words, for example, a depressed person’s spoken words may contain more negative emotions or even some extreme emotions, and deep depression may contain special words such as self-mutilation, giving up, and sadness, all of which are things that the AI can do through the language model that belongs exclusively to the user. language modeling. It’s not just the patient who is making the AI more suitable for them, the AI is also collecting data from the user’s conversations to get to know them better so that it can make sound judgements and appraisals thus helping them to alleviate those kinds of emotions and feelings. The collected data can even be shown directly to the doctor, through long-term data records to show the patient’s mood changes at different times due to different things, better and more directly show the extent of the patient’s current mental problems, to better help psychologists understand the patient’s situation. This eliminates the tradition of relying on doctors to keep track of their patients by questioning them, a step they can eliminate by understanding the AI’s data directly. This also allows them to concentrate more on how to help the user even better and be more comfortable communicating with them, and these are the benefits that can be made by building a proprietary language model.

On the other hand, another reason why many depressed and autistic people don’t want to establish direct communication with other people is because they are afraid that they will be annoyed or fed up with themselves or the emotions that they are venting out, and they are afraid of what other people will think of them and what they won’t understand. However, these problems are unlikely to arise when using an AI as a communicator, as the user doesn’t need to think about how his or her words will affect the AI’s emotions because they don’t, and this allows the user to soothe his or her own emotions by expressing any emotions or things to the AI as he or she pleases. They can seek them out at any time or place, no matter how long they talk or how negative the conversation is, it won’t affect them, and they can become a kind of virtual companion that belongs to them. All of these methods can make them trust and build communication with the AI to ease and stabilize their mental state. Doctors can even communicate with the developers to make small changes to the AI’s communication style to guide them. For example, when patients show self-depreciation or dissatisfaction, timely let the AI to encourage or through other ways to ease and relieve their emotions, in the relief of negative energy and at the same time with positive energy to motivate each other, to encourage the user to try to accept and other people’s normal communication or emotional expression. Further, the AI can even be used as a social practice for the patient. People with autism can start to engage in dialogue and communication with their familiar AI in various situations or scenarios, to practice facing such situations on their own and become familiar with how to socialize. Then later the AI’s language model could be switched to allow them to try communicating with strangers, or other more complex social situations. This kind of staged practice might ease their symptoms, help them become more familiar with communicating with strangers, and allow them to grow.

This approach could continue to be further enhanced by virtual reality, allowing the AI to gain physical presence in VR and communicate with the user in a customizable virtual environment. For example, creating multiple different avatars and allowing the user to choose and then use them in the virtual environment to give the user a more concrete impression and concept of the AI. The user can even be programmed to interact with the AI avatar, allowing the AI to react to both the user’s actions and words, thus providing better feedback to the user. The benefits of this are hard to replace with any other electronic media, and the unique immersion of virtual reality may interest the user to voluntarily use it for a longer period of time and communicate with the AI in a more proactive manner. These are the benefits of using AI in virtual reality as a communication object for autism and depression, and the combination of AI language modeling and virtual reality is difficult to replace in other multimedia.

But the pitfalls are also present in this idea at the same time, and many hidden issues might have an impact especially in this aspect of AI. In terms of security, the controllability of AI and the training of language models requires the frequent collection of information about the user, from the way they speak to their complete personality preferences. This can be potentially dangerous, as the information collected can have serious consequences if it is stolen or used elsewhere, and if such an incident occurs can it lead to other users questioning their trust in the AI, leading to a reduction in their interest in communicating with it. Secondly, how to let the AI correctly judge and identify the user’s emotions is also a problem that needs to be thought about, because different people have different expressions and understandings of emotions, which may lead to it not being able to correctly understand the user’s emotions in the early stages of use. A fully tested language model may be difficult to use for others after it has been applied to one person, and end up being a completely customized thing, resulting in data that cannot be shared between them. This makes it difficult for developers to understand the deficiencies and shortcomings of the AI, making it difficult for them to make further improvements. As a final point, while it is indeed good for users to become interested in using this communication, it may also have chances of causing them to become dependent on it and end up being addicted to the virtual world. These negative effects are objective and can have unpredictable effects on the user.

Overall, in terms of helping with mental issues such as depression and autism, using a combination of virtual reality and artificial intelligence has the potential to help them develop a viable means of communicating and venting their emotions. Most of these benefits come from the immersion of virtual reality, a communication environment that can be tailored to the user’s language model and under the user’s control. Whilst there are some potential downsides to the use of this method, such as the personal information collected or an over-reliance on this method, these issues can probably be improved or amended in some other way. Perhaps this approach can be further improved in the future or inspire others to discover new ways of using virtual reality and artificial intelligence together. (2115words)

Let’s talk facts about depression – PPCN. (2015)Available at: https://www.ppcn.org/Education_Handouts/Let-s-Talk-About-Depression-Brochure.pdf (Accessed: 07 December 2023). 

Baron‐Cohen, S. (2009) ‘Autism: The empathizing–systemizing (E‐S) theory’, Annals of the New York Academy of Sciences, 1156(1), pp. 68–80. doi:10.1111/j.1749-6632.2009.04467.x. 

Berşe, S. et al. (2023) ‘The role and potential contributions of the Artificial Intelligence Language Model CHATGPT’, Annals of Biomedical Engineering [Preprint]. doi:10.1007/s10439-023-03296-w. 

Cronin, C.J., Forsstrom, M.P. and Papageorge, N.W. (2020) What good are treatment effects without treatment? mental health and the reluctance to use talk therapy, NBER. Available at: https://www.nber.org/papers/w27711 (Accessed: 07 December 2023). 

Eysenbach, G., Publications, J. and Eysenbach, C.A. (2023) The role of CHATGPT, generative language models, and Artificial Intelligence in medical education: A conversation with chatgpt and a call for papers, JMIR Medical Education. Available at: https://mededu.jmir.org/2023/1/e46885/ (Accessed: 07 December 2023). 

Sundar, S.S. and Lee, E.-J. (2022) ‘Rethinking communication in the era of Artificial Intelligence’, Human Communication Research, 48(3), pp. 379–385. doi:10.1093/hcr/hqac014. 

Categories
contextual-theoretical-studies-2 Uncategorised

Week 7

“The Role and Potential Contributions of the Artificial Intelligence Language Model ChatGPT”

While most of this post is talking about how chatbots are becoming an area of continuing education, counselling and information access for nurses. But he benefits and limitations of AI as a communicator. While it can quickly pick up expertise and make quick judgements based on conversations, it can also have issues with providing inaccurate or biased information, as well as its most worrisome collection of personal information. These are all areas that could be discussed further. For example, AI can be used to detect emotions or specific words in a user’s speech to determine the user’s state of mind, such as a depressed person’s speech, which may be more likely to be negative or even extreme, as a way to help with communication therapy.

Categories
contextual-theoretical-studies-2 Uncategorised

Week 6

Depression and Autism

What do I intend to know when I completed this research project

Can Ai use for mental with VR? What can it do in the future? 

Analysis

What INF can I got when I completed the project

INF about how Ai use on mental? What can it do? How can it be part of VR EX? Why to use it and why not?

Need new INF about how Ai communicate with human, paper, test result, 

Evaluation 

I will discuss about Ai use in VR for phobia/mental health in order to show affect on user’s mental and enhance the VR EX.

I will show VR therapy Program can be better for mental/different kind of phobia that using Ai as part of process.

Categories
contextual-theoretical-studies-2 Uncategorised

Week 1

Early thoughts

Categories
Virtual Spaces

Week 25

Evaluation and review

In the project “Lighthouse”, I was concerned with the fact that the plot of this animation is set in a future era, an era where humans are already very familiar with and use robots and artificial intelligence. Many jobs that are fraught with danger and far from human society have been replaced by different kinds of robots. In the animation, a large robot replaces the lighthouse and the lighthouse keeper because of the danger and solitude of the job. The animation shows a dormant old lighthouse robot sitting on an island far from the city, blending in with its surroundings. That is, until one night when storm conditions in the nearby waters worsen and the waves begin to affect a nearby ship. The ship’s alarm was detected by the lighthouse and it was activated once again. The giant robot slowly rises from the island and begins to slowly and heavily turn around and start walking in the direction of the ship to save and help the nearby ships.

Based on the feedback given to me about this 3D world and animation project, there is a section on my direction and the theoretical knowledge I have gained from this work that can also be used to help me in my creative practice. Due to the specificity of maya and the fact that this is the first time I have tried and learnt the software and skills involved. I need to have ideas, experiment on different levels and have the ability to explain to others the direction I want to explore and understand. There is also the ability to implement innovation well in the development of the project.

But on the other hand. After self-examination and feedback, I have recognised the problems that exist. There are different levels of issues that I need to address in each part of my 3D world and animation. Firstly, I need to learn a better way to use the implementation of feedback in maya. Also, I need to learn how to use more software and plugins in maya to help me express my projects better, such as adding more attempts to prove my ideas and the ability to maintain my logic and continuity of work. Also, I need to experiment more with new materials and new ways of modelling, choosing carefully which materials I need and might use so that I can strengthen my skills and knowledge of materials to experiment with in my 3D world and in my animations. Most importantly, I need to apply professional behaviours effectively in my practice and improve my productivity. I need to develop a daily schedule through thorough reflection and personal development to help me start working and practising creatively and effectively. However, due to my laptop hardware, unity’s entire animation seemed out of reach and the long loading times often crashed my computer, which caused major problems for me at the end of using unity.

 Overall, animating characters using skeletons and rig in maya was a new thing for me personally. Not only that, but because my character is a robot it doesn’t have the same skeletal system as normal human skin, thus taking me a lot of time to work out and learn this stuff. But it also helped me, now I understand the character skeleton which I then use multiple methods to create and have some knowledge of it. On the other hand, in this area of motion capture I used them later due to equipment and various delays. And because my character is a robot, its movements should be different from those of a normal human. However, I didn’t take this into account, which led to a lot of problems with the motion capture animations, such as different bones, misalignment and conflicts between models, which took me a long time to adjust and change. The last problem was that when I tried to export to untiy there were often some decals that disappeared and reappeared, I didn’t solve and understand this problem in the end, which is a pity, maybe I need more time to understand unity and maya.

Overall, for me personally, Maya and unity is still a software and skill that deserves more time to explore. Each one of them is worth more time for me to learn.

Categories
Virtual Spaces

Week 23

Categories
Virtual Spaces

Week 22

Plot and characters

Plot Outline

The plot of this anime is set in a futuristic time, a time when humans are already familiar with and use robots and artificial intelligence with great intensity. Many jobs that are fraught with danger and far from human society have been replaced by different kinds of robots. The animation shows a large robot replacing a lighthouse and lighthouse keeper’s job because of the danger and loneliness of the job, and shows a dormant old lighthouse robot sitting on an island far from the city and blending in with its surroundings. It is not until one night when the stormy conditions in the nearby waters deteriorate and the waves start to affect a nearby ship. The ship’s alarm is detected by the lighthouse and it is activated once again. The giant robot slowly rises from the island and starts to slowly and heavily turn around and start walking in the direction of the ship in order to save and help the nearby ships.

Characterization

A giant lighthouse robot, basically 10-15m high. Not only its old model but also because of its huge size, its movements look slow and heavy. The column on its head is actually a light-emitting part, similar to the principle of a lighthouse, which guides and warns of approaching ships and can be used to receive distress signals. The robot is painted in orange and black stripes to make it more visible in the sea, but due to long periods of inactivity and lack of maintenance, much of it has been corroded to reveal its original metallic colours and rust, especially on the lower part, which has been immersed in the sea for years. To power its huge body and engines, two heat sinks on its shoulders emit a black puff of smoke when activated.

Plot script

The camera starts with a blur, which only captures the front of the robot’s head and the part of the lighthouse that is not working (the area around the head is covered with plants and vines, creating a sense of disuse that has not been used for a long time). The camera then gradually moves backwards and pulls up higher at the same time, gradually zooming in to capture the entire island. The entire robot can be seen collapsed on the island, with its back against the only hill on the island, the upper half of its body leaning on the hill while the lower half is submerged in water near its feet. Bright sunlight shines on the lifeless robot (Fig. 1, the white and middle jar part serves as the island and the hill, the silver is the ocean that surrounds the island). The small island is surrounded by blue-green water, around which nothing but seawater can be seen. The whole scene mainly presents a kind of oceanic island deserted in the daytime sun, but full of natural life. (The whole scene lasts 6-8 seconds)

Act II, (Same position as the final shot of Act I.) A loud thunderclap and the scene changes to a dark night, with a huge storm at sea and lightning sweeping through the surrounding waters. (The scene lasts 6-8 seconds) until a ship appears in the distance, hidden by an island, and slowly moves between the waves until a loud ship’s whistle sounds. This whistle sounds like an alarm triggering the robot to run and (the camera starts to follow the robot) its lighthouse and eye parts start to glow orange. As if activated, the robot slowly starts to stand up, first by slowly tightening its legs in preparation for supporting itself, first by favoring the left leg part, and then by slowly organizing the rest of itself to stand up (the whole movement is much slower than normal in order to convey the mechanical feel and the sheer size of the robot) (the camera slowly rises with the robot’s movements and holds it in place once it is fully standing) 

After standing fully the robot turns to look in the direction of the ship, (the silver screw represents the cargo ship) and after confirming its target turns and starts walking towards the ship, the sea water flooding its lower limbs more and more with each step it takes. (The robot walks towards the ship with its back to the camera) Ending the shot after four or five steps.

Categories
Contextual & Theoretical Studies 1

Week 22

Based on the information from this project and the knowledge from the class, I realised that immersion and reality can affect people in different ways, for example, when people feel fully immersed, people can confuse the gap between reality and virtual and thus be affected by the virtual. Based on this knowledge and understanding, if I could change the existing VR experience, I would want to make the virtual environment more realistic to enhance immersion and thus move towards the possible idea of VR mental health therapy. I believe that better immersion and virtual environments would make it easier for people to relax, thus making psychotherapy more effective. With this in mind, I began an initial search for information and concrete examples of psychotherapy and virtual reality. Interestingly enough, people are already experimenting with virtual reality technology to treat different psychological disorders as an alternative to some real-life treatments.

At the very beginning, after the initial reading and understanding of this material, two issues came to mind that I was particularly concerned about and wanted to expand on. The first issue was how to use and how to improve the use of exposure therapy in virtual reality. This issue focuses on different treatments for phobias that allow the user to directly confront the thing or environment they are afraid of. This requires a great deal of immersion and realism in the virtual environment, an issue that has been tried and tested in the medical world and examples have been reported. But then I developed another idea, which was to use virtual reality to help restore and learn some of the social dysfunction of people with mental illness, allowing the user to slowly accept and learn some basic behaviours or problems so that they can be treated differently. However, as there are many different types of mental illness and different behaviours between patients, this remains a matter of discussion and theory. Based on the question of whether virtual reality technology is appropriate and how it can be used for work related to the treatment of mental illness and mental disorders, I began to look for further information and confirm my direction.

After a certain amount of information seeking and understanding, I began to confirm the direction of this thesis. I wanted to further discuss how virtual reality can help people with mental illness to recover and learn from some of their social dysfunctions, and to do so more in terms of the immersion in reality that virtual reality creates. Among the many psychiatric problems I have inquired about is probably the most vulnerable to virtual reality, a psychiatric problem known as Maladaptive Daydreaming, a mental health problem in which a person daydreams or fantasises excessively. It is a psychologically unhealthy or negative attempt to cope or adapt to a real problem. People who do this often gradually lose their ability to recognise in extremely vivid and detailed daydreams. Many sources also suggest that such daydreaming may be spontaneous and according to these sources that the problem is still mainly caused by anxiety, depression and other mental health conditions resulting from excessive real-life stress. The main problem is that there is not a good treatment plan in place, as it is not yet an official mental illness, so there is no standard treatment. However, many sources suggest that the main treatment for Maladaptive Daydreaming is mental health therapy. Which is called cognitive behavioural therapy (CBT) is also a common approach to treating anxiety and depression. This approach focuses on allowing the patient to release and relieve some of their stress by communicating or portraying what they are thinking and wanting to do.

From this material I began to wonder if virtual reality could be used in a similar way to help such patients to release their stress. By using drawings, models, or other methods to recreate their fantasy scenes in virtual reality, or by showing them to others, even those who are reluctant or inept at communicating could use VR to perform CBT therapy. This approach is basically risk-free and not more psychologically taxing for the user, and perhaps they can slowly show and present themselves through this act to gradually treat this mental health problem, and in the end this virtual fantasy reality presentation could perhaps be used for other similar mental health problems that use CBT therapy. So my final question might be whether and how virtual reality can be used to treat Maladaptive Daydreaming a similar way to CBT.

Categories
Virtual Spaces

Week 21- Model refinement&UV

Reconstruction of character models and refinement of model UV

As the clay model I created did not meet my vision for this, I recreated this robot character model directly in the computer in the meantime.

After I had created the model I started to try to change its UV map, but an accident happened that I did not expect. Because I had created too many square-like mechanical surfaces, they each had tiny, individual surfaces as shown in the upper part of the picture above, overly repetitive and unidentifiable squares. I don’t know if it was the excessive threads that caused my computer to lag or what, but I couldn’t get the model to stitch properly, even though I had successfully used the technique on the previous model.

In the end, several unsuccessful attempts at stitching the UV line I tried another way to make up for this blunder. First of all, I UV’d the different parts of the model, left and right hand, head, chest, waist, bottom and both legs, as shown in the picture above. As I had envisioned most of the robot’s skin to be more of an old monochrome metallic look, I placed the glowing and special areas at the bottom for alteration, such as the camera mirror on the head, the screen and backpack on the chest and the signal unit at the top.

Categories
Virtual Spaces

Week 19-20 3D Scan

3D scanning of the model and testing of the model

After mastering the relevant 3d scanning techniques, I started to use the relevant parts to describe the robot model. From taking plural photographs of the model from different angles and using metashape to create a digital model of it, to importing it into software to further modify it and finally to recreate a UV map of the model. During this process, I found that the model created by the 3D scan was not suitable for the robot character. The clay model I had created did not meet my vision for this, so I felt that recreating the model directly in the computer and using it would give better results than this technique.