Breaking News
light_mode
Trending Tags
Beranda » Software » The Future of Mixed Reality: Blending the Virtual and the Real

The Future of Mixed Reality: Blending the Virtual and the Real

  • account_circle Lili Cheng
  • calendar_month Selasa, 28 Jan 2025
  • comment 0 komentar
  • print Cetak

At Microsoft Ignite 2023, we are announcing Copilot in Microsoft Dynamics 365 Guides, which combines the power of generative AI with mixed reality to help frontline workers complete complex tasks and resolve issues faster with less disruption to the flow of work.

Copilot in Dynamics 365 Guides assists workers in industrial settings who deal with complex equipment and processes. New technicians need to ramp up quickly while learning how to operate and service that equipment. When equipment stops functioning, workers must act quickly to diagnose the problem, implement a fix, and then document their work. Instead of workers needing to search through volumes of digital documents or paper manuals, Copilot enables workers to ask for relevant information using natural language and human gestures, such as looking and pointing. Copilot uses generative AI to search for information from technical documentation, service records, training content, and any other data sources that customers curate. Copilot then summarizes the information to provide interactive guidance through content and holograms overlaid on the equipment in operation or maintenance.

Mixed reality together with AI presents a human-first interface that promises to transform real-world operations. Now, Copilot can assist industrial workers in real-time with speech and holograms.

Copilot in Dynamics 365 Guides capabilities

Here are the capabilities we plan to unlock with Copilot in Dynamics 365 Guides:

Point and Ask Guidance

Humans have always learned from and interacted with their environment in a hands-on manner, asking questions of others as they work. Copilot in Dynamics 365 Guides builds on that natural way of interacting to help workers better understand the world around them. Workers can point to a component on an asset and ask Copilot questions, such as “What is the torque limit for these bolts?” New workers can ask general questions, such as “What is the function of this component?” without needing to interrupt a more experienced coworker. Copilot recognizes what the user is pointing at and provides answers. 3D models and spatial maps provide the foundation for the technology to identify what the worker is looking at and then project a hologram to show instructions. Workers can ask more complex questions, such as “Which direction does this part fit?” or “Show me where the sensor module is on this machine,” and Copilot will display holograms to show where the part belongs.

Spatial Content Generation

Copilot in Dynamics 365 Guides accelerates the out-of-the-box value of mixed reality by significantly reducing the upfront investment needed to create spatial content. Copilot simplifies the creation, management, and delivery of mixed reality content using customer-defined data sources, enabling companies to adopt mixed reality much faster.

Step-by-Step Assistance

Powered by Microsoft Azure OpenAI Service, large language models allow Copilot in Dynamics 365 Guides to do far more than answer one-off questions. Workers can have progressive conversations, such as “Walk me through the steps to disassemble this filtration unit,” or “I disconnected the motor, what’s next?” Copilot follows along with the process and conversation using customer’s curated knowledge base to articulate answers with speech, text, or 3D holograms, eliminating ambiguity and reducing the need for rework.

Komentar (0)

Saat ini belum ada komentar

Silahkan tulis komentar Anda

Email Anda tidak akan dipublikasikan. Kolom yang bertanda bintang (*) wajib diisi

Rekomendasi Untuk Anda

  • Atas Aspirasi Usman Husin: Hari Ini Tim BBWS Nusa Tenggara II Telah Turun ke Embung Livuhanik Rote, Akan Ada Perbaikan

    Atas Aspirasi Usman Husin: Hari Ini Tim BBWS Nusa Tenggara II Telah Turun ke Embung Livuhanik Rote, Akan Ada Perbaikan

    • calendar_month Rabu, 21 Okt 2026
    • account_circle Mario
    • visibility 76
    • 0Komentar

    NTT, Jarrakpos.com- Aspirasi masyarakat Desa Lanteran, Kabupaten Rote Ndao, terkait kondisi Embung Livuhanik yang kering total dan mengalami kerusakan pintu air mulai mendapat tindak lanjut. Setelah menerima keluhan masyarakat, Anggota DPR RI Fraksi PKB Komisi IV, Usman Husin, bergerak cepat membangun koordinasi dengan kementerian terkait. Hasilnya, Kementerian Pekerjaan Umum melalui Balai Besar Wilayah Sungai Nusa […]

  • Perdana Gelar Turnamen Tenis Meja Se-Kabupaten Kuningan, PTM Jembar Sedot 174 Peserta

    Perdana Gelar Turnamen Tenis Meja Se-Kabupaten Kuningan, PTM Jembar Sedot 174 Peserta

    • calendar_month Minggu, 9 Agt 2026
    • account_circle Ghana
    • visibility 138
    • 0Komentar

    KUNINGAN, Jarrakpos.com – Persatuan Tenis Meja (PTM) Jembar yang berlokasi di Kelurahan Purwawinangun, Kecamatan Kuningan, sukses menggelar Turnamen Tenis Meja tingkat Kabupaten Kuningan untuk pertama kalinya. ​Acara dibuka secara resmi oleh Wakil Bupati Kuningan, Tuti Andriani, S.H., M.Kn., dengan didampingi oleh Plt Kepala Dinas Pemuda Olahraga, dan Pariwisata (Disporapar) serta Kepala Bidang Olahraga Kabupaten Kuningan. ​Ketua […]

  • Kasdam XIX/Tuanku Tambusai Cek Kesiapan Operasional Yonif 132/BS di Kabupaten Kampar

    Kasdam XIX/Tuanku Tambusai Cek Kesiapan Operasional Yonif 132/BS di Kabupaten Kampar

    • calendar_month Selasa, 20 Okt 2026
    • account_circle Diana Ningsih
    • visibility 49
    • 0Komentar

    KAMPAR.Jarrakpos.com – Kepala Staf Kodam (Kasdam) XIX/Tuanku Tambusai melaksanakan kunjungan kerja ke daerah latihan Batalyon Infanteri (Yonif) 132/BS di Kolat Proglatsiops Sistem Blok dan Latihan Penyiapan Pratugas, Kecamatan Salo, Kabupaten Kampar, Riau, Senin (19/10/2026). Kunjungan ini bertujuan meninjau pelaksanaan latihan sekaligus memastikan kesiapan satuan dalam menghadapi tugas operasional. Kasdam XIX/Tuanku Tambusai tiba di lokasi pada […]

  • Kepsek SMPN 14 Dumai Apresiasi Kegiatan BPBD, Tekankan Pentingnya Edukasi Kebencanaan Sejak Dini

    Kepsek SMPN 14 Dumai Apresiasi Kegiatan BPBD, Tekankan Pentingnya Edukasi Kebencanaan Sejak Dini

    • calendar_month Selasa, 13 Okt 2026
    • account_circle Diana Ningsih
    • visibility 54
    • 0Komentar

    DUMAI.Jarrakpos.com – Perwakilan SMP Negeri 14 Kota Dumai menyampaikan apresiasi dan terima kasih kepada Badan Penanggulangan Bencana Daerah (BPBD) yang telah melibatkan pihaknya sebagai salah satu peserta dalam kegiatan edukasi kebencanaan.13/10/26 Kegiatan yang digelar di pusat perbelanjaan tersebut dinilai sangat penting dan positif, terutama dalam memberikan pemahaman kepada anak-anak sejak dini tentang cara mencegah dan […]

  • Aksi Cinta Berujung Viral! Mahasiswa UTM Nyamar Jadi Cewek Demi Ketemu Mantan

    Aksi Cinta Berujung Viral! Mahasiswa UTM Nyamar Jadi Cewek Demi Ketemu Mantan

    • calendar_month Minggu, 26 Okt 2025
    • account_circle Kang Yos
    • visibility 407
    • 0Komentar

    Viral di Medsos Video seorang mahasiswa Universitas Trunojoyo Madura (UTM) digiring polisi menjadi perbincangan hangat di media sosial. Dalam video itu, pria tersebut disebut-sebut menyamar memakai hijab dan masuk ke kos putri sambil membawa senjata tajam (sajam) dan minuman keras. Namun, klarifikasi dari pihak kepolisian mengungkap fakta yang berbeda. Polisi Luruskan Isu Kasihumas Polres Bangkalan, […]

  • Kemenkum Jabar Bersama Pemprov Jawa Barat Perkuat Sinergi dan Sepakati Kolaborasi Strategis

    • calendar_month Senin, 20 Jan 2025
    • account_circle Redaksi
    • visibility 637
    • 0Komentar

    Jarrakpos.com. Bandung – Dalam upaya memperkuat sinergi antarlembaga, Kantor Wilayah Kementerian Hukum (Kemenkum) Jawa Barat menggelar audiensi bersama Sekretaris Daerah (Sekda) Provinsi Jawa Barat, Herman Suryatman pada Senin 20 Januari 2025.   Kegiatan ini berlangsung di Rumah Dinas Sekretaris Daerah Jawa Barat, menghadirkan Kepala Kanwil Kemenkum Jabar, Asep Sutandar, beserta jajaran pimpinan tinggi pratama, pejabat […]

expand_less