《溶解的记忆》

“Melting Memories”代表着当代艺术与先进技术相结合的全新可能性。通过展示这些跨学科的作品，设计师将这些难懂的记忆过程检索成数据信息。在此次展览中，Anadol的视觉创意会带领来访者畅游在记忆的世界里。

Melting Memories offered new insights into the representational possibilities emerging from the intersection of advanced technology and contemporary art. By showcasing several interdisciplinary projects that translate the elusive process of memory retrieval into data collections, the exhibition immersed visitors in Anadol’s creative vision of “recollection.”

“科学描述事物的含义，而艺术却可以将它们表达出来，”美国哲学家John Dewey写到。他将被他视作两个学科之间交流的主要模式进行了与众不同的区分。在“Melting Memories”作品中，Refik Anadol以极富表现力的方式，和极具揭露性和发人沉思的艺术作品，向参观者描绘了Dewey的这一理论。

“Science states meanings; art expresses them,” writes American philosopher John Dewey and draws a curious distinction between what he sees as the principal modes of communication in both disciplines. In Melting Memories, Refik Anadol’s expressive statements provide the viewer with revealing and contemplative artworks that will generate responses to Dewey’s thesis.

包含数据绘画，扩增数据雕塑和光投影在内，该作品首次以先进的技术和艺术的形式，为参观者呈现了人脑的运行机制。每一件作品均获得了加州大学Neuroscape Laboratory实验室最先进的技术支持，给人留下了深刻的印象。Neuroscape是一家神经系统科学研究机构，他们致力于健康及受损脑功能领域的技术创新和科学研究。Anadol从脑电图中收集人脑在认知控制下的神经机制数据，这一数据体现了脑波运动，提供了大脑在不同时间里的运作证据。这些数据的集合，为艺术家打造多维度视觉模型作品提供了有力支撑。

Comprising data paintings, augmented data sculptures and light projections, the project as a whole debuts new advances in technology that enable visitors to experience aesthetic interpretations of motor movements inside a human brain. Each work grows out of the artist’s impressive experiments with the advanced technology tools provided by the Neuroscape Laboratory at the University of California, San Francisco. Neuroscape is a neuroscience center focusing on technology creation and scientific research on brain function of both healthy and impaired individuals. Anadol gathers data on the neural mechanisms of cognitive control from an EEG (electroencephalogram) that measures changes in brain wave activity and provides evidence of how the brain functions over time. These data sets constitute the building blocks for the unique algorithms that the artist needs for the multi-dimensional visual structures on display.

Anadol的装置作品不仅带来了先进科技和艺术的成果性展示，还为参观者带来了从古埃及时期到Blade Runner 2049未来世界的人类记忆研究。此次展览的主题“溶解的记忆”，暗指了艺术家活跃在各种开创性哲学作品相互作用关系之间的经验，以及他众多以记忆为主旨的学术研究和艺术作品。此外，该主题还进一步引起了人们对神经系统学与科学的融合这一长达数个世纪的哲学争论的关注，抛出了对人工智能不再与个体和私隐相冲突的新时代的质问。

Anadol’s installations do not only address a productive espousal of cutting-edge technology and art but also a strong preoccupation with the study of human memory from Ancient Egyptians to Blade Runner 2049. The exhibition’s title, Melting Memories, refers to the artist’s experience with unexpected interconnections among seminal philosophical works, academic inquiries and artworks that take memory as their principal themes. The title further draws attention to the melting of neuroscience and technology into these centuries-long philosophical debates, questioning the emergence of a new space where artificial intelligence is not in conflict with individuality and intimacy.

过程

PROCESS

该数据收集过程使用了32频传感器Enobio和标准协议配置。在收集过程中，参与者根据指示进行一段特定的长期记忆。过程中还进行了对照记录来识别伪影，以便之后利用自适应陷波滤波和限制频率范围进行滤波。分析中，设计师聚焦在β(13-17Hz)和θ(3-7Hz)的频段上，分离与短期和长期记忆一致的激活点。之后选择在Fp1、Fp2、F7、F8、P3、P4、C3、C4、T7、T8、O1和O2的节点，这些节点也在实时模拟中驱动噪声参数。在缩放中设计师采用了Higuchi分形维数算法，并用FFT作为移动平均值。在记录会话中使用递归神经网络生成频谱输出，再将其用作视觉表示流水线的高度图。

Data collection process utilized a 32-channel Enobio and standard protocol configuration. Participants were instructed to focus on specific long-term memories during the recording process. A control recording was also conducted to identify artifacts to later filter with adaptive notch filtering and limiting the frequency range. For analysis we focused on beta (13-17Hz) and theta (3-7Hz) channels, isolating activation points corresponding to short term and long-term (specifically episodic) memory. Our selections were the Fp1, Fp2, F7, F8, P3, P4, C3, C4, T7, T8, O1, and O2 nodes, which were also used to drive noise parameters within the real-time simulation. For scaling we applied Higuchi’s fractal dimension algorithm and used FFT for a moving average. Recurrent neural nets (via EEGLearn) we used on the recording sessions to generate spectral outputs, which were then utilized as height maps for the visual representation pipeline.

VVVV工作流程

VVVV Workflow

将EEG数据转换为程序噪声形式是一个在技术层面和概念层面都非常具有挑战性的工作。在输入数据和在设计师映射的陈述中，你可以发现节奏与循环，但也暗示了更高的空间维度。设计团队希望能够实时和高效的完成这项任务，因此，他们将“Melting Memories”与最后一次触及FieldTrip（HLSL/VVVV的开源GPU库）的过程密切衔接。这使得设计团队可以用复合设计模式快速的迭代重复，同时打造富有美学效果的装置形态。这个方法使设计师能够真正探索一些深层次的程序功能，同时保持一种完全模式化的图形流水线。这种模块性令抽象性内容以真实和有趣的方式表达，且让这一表达变得简答和清晰，如进一步将机器学习能力与数据资源进行整合，或进化渲染技术与实体作品的雕塑性。

Transposing EEG data in to procedural noise forms was a really engaging challenge, both technically and conceptually. In the input data and our mapped representation you can find recurrence and rhythm but also hints of higher dimensional structures. We wanted to do this efficiently and in real time and so working on Melting Memories dovetailed nicely with putting the last touches on FieldTrip, an (at the time pre-release) open source GPU library for HLSL/VVVV. It allowed us to use a composite design pattern to very quickly iterate while producing the aesthetic structures used in the project. This approach enabled us to really explore some deeper procedural functions whilst keeping a completely modular graphics pipeline. This modularity makes it easy and clean to expand on the project’s abstracted content in really interesting ways, such as further integration of machine learning on the source data, evolving rendering techniques and the creation of sculpted physical artifacts.

Designed &Developed at Refik Anadol Studio

Nicholas Boss

Efsun Erkilic

Kian Khiaban

Ho Man Leung

Raman K. Mustafa

Toby Heinemann

Sound Design : Kerim Karaoglu

Software Development : Kyle McLean / Steffan Klaue

Scientific Support

UCSF / Neuroscape Lab Members

Adam Gazzaley, M.D., PH.D.

Locations

Pilevneli, Istanbul, TR

Dates

02/07/2018 – 03/17/2018

Mediums

Data Sculptures

5 Meters by 6 Meters custom LED Media Wall

Data Paintings

65” 4K OLED Display

Custom Software (VVVV)

CNC Milled Rigid Foam