nsight monitor что это
NVIDIA Nsight Graphics
NVIDIA® Nsight™ Graphics is a standalone developer tool that enables you to debug, profile, and export frames built with Direct3D (11, 12, DXR), Vulkan (1.2, NV Vulkan Ray Tracing Extension), OpenGL, OpenVR, and the Oculus SDK.
Version 2021.5 Release Notes | Revision History
NVIDIA® Nsight™ Graphics is freely offered through the NVIDIA Registered Developer Program
Range-Based GPU Profiling
GPU Trace
Nsight Aftermath
Ray Tracing Debugging
C++ Capture Export
Pixel History
Images of Hellblade™: Senua’s Sacrifice courtesy of Ninja Theory Ltd.; Hellblade is a Direct3D 11 game based on Unreal Engine 4
What People Are Saying
«Dassault Systèmes and its SOLIDWORKS brand have always supported bleeding edge rendering technologies from NVIDIA. Nsight Graphics is one of our go-to graphics debugging tools. With valuable features like C++ Capture and Pixel History, Nsight Graphics has enabled us to solve complex rendering problems with ease.»
—Siddharth PALANIAPPAN, SOLIDWORKS Graphics R&D Development Senior Manager, Dassault Systèmes
NVIDIA Nsight Integration
NVIDIA Nsight Integration (highlighted) under the Nsight menu
NVIDIA Nsight Developer Tools Integration for Visual Studio
NVIDIA Nsight Integration is a Visual Studio extension that allows you to access the power of the following NVIDIA Nsight standalone tools from within Visual Studio.
Revision History | Documentation
NVIDIA Nsight Integration is freely offered through the Microsoft Visual Studio Marketplace
Key Features
[1] As of Nsight™ Visual Studio Edition 2020.2, released in September 2020, VS2015 support has been deprecated and will be removed in an upcoming release.
Gallery
Visual Studio project settings are transferred to the Nsight standalone tool
Key binding support for quick access
Enable/Disable tools to control visibility in Nsight menu
NVIDIA Nsight Systems
NVIDIA® Nsight™ Systems 是一个系统级性能分析工具，专用于实现应用算法的可视化，以帮助您发现诸多优化机会，以及进行调优以便跨任意数量或大小的 CPU 和 GPU（从大型服务器到较小的 SoC）进行高效扩展。
NVIDIA Nsight Systems是一款低开销性能分析工具，旨在为开发人员提供优化软件所需的洞察力。无偏差的活动数据可在工具中可视化，可帮助用户调查瓶颈，避免推断误报，并以更高的性能提升概率实现优化。用户将能够识别问题，例如 GPU 闲置、不必要的 GPU 同步、CPU 并行化不足，甚至其目标平台的 CPU 和 GPU 中意外昂贵的算法。它旨在跨各种 NVIDIA 平台进行扩展，例如：大型 Tesla 多 GPU x86 服务器、Quadro 工作站、支持 Optimus 的笔记本电脑、配备 Tegra+dGPU 多操作系统的 DRIVE 设备，以及 Jetson。NVIDIA Nsight Systems 甚至可以为 PyTorch 和 TensorFlow 等深度学习框架行为和负载提供宝贵见解；允许用户调整模型和参数，以提高单个或多个 GPU 的整体利用率。
了解您平台上的 Nsight Systems：
2021.2 – 发布公告
2021.1 – 发布公告
2020.5 – 发布公告
2020.4 – 发布公告
可以直接在 Linux 工作站和服务器上（包括 NVIDIA DGX 系列）进行分析，也可以通过各种主机（Windows、Linux 或 MacOSX）进行远程分析。
2021.2 – 发布公告
2021.1 – 发布公告
2020.5 – 发布公告
2020.4 – 发布公告
可以直接在 Linux 工作站和服务器上（包括 NVIDIA DGX 系列）进行分析，也可以通过各种主机（Windows、Linux 或 MacOSX）进行远程分析。
Visual Studio Integration*需要安装 Nsights Sytems
2019.4
2019.3
以下产品开发套件附带 Nsight Systems：
| 功能 | Linux 工作站和服务器 | Windows 工作站和游戏 PC | Jetson 自主机器 | DRIVE 自动驾驶汽车 |
|---|---|---|---|---|
| 查看跨 CPU 和 GPU 的系统级应用程序行为 | ||||
| CPU 核心利用率、进程和线程活动 | 是 | 是 | 是 | 是 |
| CPU 线程周期性采样回溯 | 是* | 否 | 是 | 是 |
| CPU 线程阻止的状态回溯 | 是** | 是 | 是 | 是 |
| CPU 性能计数器采样 | 否 | 否 | 是 | 是 |
| GPU 应用追踪 | 是 | 是 | 是 | 是 |
| GPU 上下文切换追踪 | 否 | 否 | 是 | 是 |
| SOC 服务器虚拟化平台追踪 | — | — | — | 是 |
| SOC 内存带宽采样 | — | — | 是 | 是 |
| SOC 加速器追踪 | — | — | Xavier | Xavier |
| 操作系统事件追踪 | ftrace | ETW | ftrace | ftrace |
| 研究 CPU-GPU 交互和泡泡 | ||||
| 用户注释 API 追踪 NVIDIA Tools Extension API (NVTX) | 是 | 是 | 是 | 是 |
| CUDA API | 是 | 是 | 是 | 是 |
| CUDA 库追踪（cuBLAS、cuDNN 和 TensorRT） | 是 | 否 | 是 | 是 |
| OpenGL API 追踪 | 是 | 是 | 是 | 是 |
| Vulkan API 追踪 | 是 | 是 | 否 | 否 |
| Direct3D12、Direct3D11、DXR 和 PIX API | — | 是 | — | — |
| OptiX | 7.1+ | 7.1+ | — | — |
| API 和 GPU 应用的双向相关性 | 是 | 是 | 是 | 是 |
| 识别 GPU 空闲和稀疏使用情况 | 是 | 是 | 是 | 是 | 多 GPU 图形追踪 | — | Direct3D12 | — | — |
| 为大数据做好准备 | ||||
| 快速 GUI，能够在笔记本电脑上可视化超过 1000 万个事件 | 是 | 是 | 是 | 是 |
| 其他命令行采集工具 | 是 | 否 | 否 | 否 |
| NV-Docker 容器支持 | 是 | — | — | — |
| NVIDIA GPU Cloud 支持 | 是 | — | — | — |
| 最低用户权限级别 | 用户 | 管理员 | 根 | 根 |
* 依托 Intel Haswell 和较新的 CPU 架构
Tracxpoint
我们注意到，新款 Quadro P6000 服务器在训练期间“闲置”，我们需要专家来为我们提供支持。NVIDIA Nsight Systems 帮助我们实现了 90% 以上的 GPU 利用率。之前训练深度学习模型需要 600 分钟，而现在只需 90 分钟。
Tracepoint 首席 AI 科学家 Felix Goldberg
NVIDIA
我使用 Nsight Systems 来分析我们的内部系统，并构建了一个计划来优化 CPU 和 GPU 占用率，最终为两者带来显著的性能和资源提升。总之，只有像 Nsight 这样的无可替代的工具，才能帮助我提取并确切了解资源使用情况所需的内容。
伊利诺伊大学香槟分校大分子建模和生物信息学 NIH 中心
观看 John Stone 相关视频，了解他如何将 VMD（一种用于分析大型生物分子系统的热门工具）的性能提升了 3 倍。
NVIDIA Nsight Visual Studio Edition 2021.3
For compute developers working in Eclipse development environment, please see Nsight Eclipse Edition
NVIDIA® Nsight™ Visual Studio Edition is an application development environment for heterogeneous platforms which brings GPU computing into Microsoft Visual Studio. NVIDIA Nsight™ VSE allows you to build and debug integrated GPU kernels and native CPU code as well as inspect the state of the GPU and memory.
Version 2021.3 New Features | Revision History
NVIDIA® Nsight™ Visual Studio Edition is freely offered through the NVIDIA Registered Developer Program and as part of the CUDA Toolkit
Debugging in Optix Applications in Nsight Visual Studio Edition
Gallery
Nsight Visual Studio Edition CUDA Debugger Key Features
Nsight Visual Studio Edition CUDA Debugger Watch Window
Nsight Visual Studio Edition CUDA Debugger Source Code View
Nsight Visual Studio Edition CUDA Debugger Breakpoints View
Nsight Visual Studio Edition CUDA Debugger Warp Info View
Nsight Visual Studio Edition CUDA Debugger GPU Registers View
More NVIDIA DevTools Visual Studio Integration
NVIDIA Nsight Integration (highlighted) under the Nsight menu
NVIDIA Nsight Developer Tools Integration for Visual Studio
In Nsight VSE 2021.3, the integrated Graphics Frame Debuggers and integrated Profilers have been removed, but don’t worry, you haven’t lost this functionality.
NVIDIA Nsight Integration is a Visual Studio extension that allows you to access the power of the following NVIDIA Nsight standalone tools from within Visual Studio.
More Nsight Visual Studio Edition Information
Downloads
Download the latest version and corresponding dependencies
NVIDIA Developer Resources (Sign up required)
Access the latest announcements, early release candidate access, file bugs, event invites and more. Sign up today!
Product Features
List of features of Nsight Visual Studio Edition
Product Requirements
Details the hardware and software support of Nsight Visual Studio Edition
Support and Documentation
User Guide, Documentation, Forums, and more
Videos
Teaser and Instructional Videos showing Nsight Visual Studio Edition in action
NVIDIA Nsight Systems
NVIDIA® Nsight™ Systems is a system-wide performance analysis tool designed to visualize an application’s algorithms, help you identify the largest opportunities to optimize, and tune to scale efficiently across any quantity or size of CPUs and GPUs; from large server to our smallest SoC.
Overview
NVIDIA Nsight Systems is a low overhead performance analysis tool designed to provide nsights developers need to optimize their software. Unbiased activity data is visualized within the tool to help users investigate bottlenecks, avoid inferring false-positives, and pursue optimizations with higher probability of performance gains. Users will be able to identify issues, such as GPU starvation, unnecessary GPU synchronization, insufficient CPU parallelizing, and even unexpectedly expensive algorithms across the CPUs and GPUs of their target platform. It is designed to scale across a wide range of NVIDIA platforms such as: large Tesla multi-GPU x86 servers, Quadro workstations, Optimus enabled laptops, DRIVE devices with Tegra+dGPU multi-OS, and Jetson. NVIDIA Nsight Systems can even provide valuable insight into the behaviors and load of deep learning frameworks such as PyTorch and TensorFlow; allowing users to tune their models and parameters to increase overall single or multi-GPU utilization.
Platforms
Learn about Nsight Systems on your platform:
Release Highlights
Downloads
Available for profiling directly on Linux workstations and servers, including the NVIDIA DGX line, or remotely from a variety of hosts: Windows, Linux, or MacOSX.
Documentation
Support
To provide feedback, request additional features, or report support issues, please use the Developer Forums.
System Requirements
Supported target operating systems for data collection:
Supported target hardware
Supported target software
Supported host operating systems for data visualization:
Release Highlights
Downloads
Available for profiling directly on Linux workstations and servers, including the NVIDIA DGX line, or remotely from a variety of hosts: Windows, Linux, or MacOSX.
Visual Studio Integration*requires Nsights Sytems to be installed
Documentation
Support
To provide feedback, request additional features, or report support issues, please use the Developer Forums.
System Requirements
Supported operating systems
Supported target hardware
Supported target software
Release Highlights
2019.4
2019.3
Downloads
Nsight Systems is bundled as part of the following product development suites:
Documentation
Support
To provide feedback, request additional features, or report support issues, please use the Developer Forums.
System Requirements
Supported Target Hardware
Supported target operating systems for data collection:
Supported host operating systems for data visualization:
Features
Learn about feature support per target platform group
| Feature | Linux Workstations and Servers | Windows Workstations and Gaming PCs | Jetson Autonomous Machines | DRIVE Autonomous Vehicles |
|---|---|---|---|---|
| View system-wide application behavior across CPUs and GPUs | ||||
| CPU cores utilization, process, & thread activities | yes | yes | yes | yes |
| CPU thread periodic sampling backtraces | yes* | no | yes | yes |
| CPU thread blocked state backtraces | yes** | yes | yes | yes |
| CPU performance counter sampling | no | no | yes | yes |
| GPU workload trace | yes | yes | yes | yes |
| GPU context switch trace | no | no | yes | yes |
| SOC hypervisor trace | — | — | — | yes |
| SOC memory bandwidth sampling | — | — | yes | yes |
| SOC Accelerators trace | — | — | Xavier | Xavier |
| OS Event Trace | ftrace | ETW | ftrace | ftrace |
| Investigate CPU-GPU interactions and bubbles | ||||
| User annotations API trace NVIDIA Tools Extension API (NVTX) | yes | yes | yes | yes |
| CUDA API | yes | yes | yes | yes |
| CUDA libraries trace (cuBLAS, cuDNN & TensorRT) | yes | no | yes | yes |
| OpenGL API trace | yes | yes | yes | yes |
| Vulkan API trace | yes | yes | no | no |
| Direct3D12, Direct3D11, DXR, & PIX APIs | — | yes | — | — |
| OptiX | 7.1+ | 7.1+ | — | — |
| Bidirectional correlation of API and GPU workload | yes | yes | yes | yes |
| Identify GPU idle and sparse usage | yes | yes | yes | yes | Multi-GPU Graphics trace | — | Direct3D12 | — | — |
| Ready for big data | ||||
| Fast GUI capable of visualizing in excess of 10 million events on laptops | yes | yes | yes | yes |
| Additional command line collection tool | yes | no | no | no |
| NV-Docker container support | yes | — | — | — |
| NVIDIA GPU Cloud support | yes | — | — | — |
| Minimum user privilege level | user | administrator | root | root |
* On Intel Haswell and newer CPU architecture
** Only with OS runtime trace enabled. Some syscalls such as handcrafted assembly may be missed. Backtraces may only appear if time threasholds are exceeded.
What Users Are Saying
Tracxpoint
We noticed that our new Quadro P6000 server was ‘starved’ during training and we needed experts for supporting us. NVIDIA Nsight Systems helped us to achieve over 90 percent GPU utilization. A deep learning model that previously took 600 minutes to train, now takes only 90.
Felix Goldberg, Chief AI Scientist, Tracepoint
NVIDIA
I used Nsight Systems to analyze our internal system and built a plan for optimizing both CPU and GPU usage, with significant performance and resource gains ultimately achieved to both. Overall, there is no alternative tool like Nsight which helps me to extract only, and exactly what I need to understand resource usage.
Sang Hun Lee, System Software Engineer, NVIDIA
NIH Center for Macromolecular Modeling and Bioinformatics at University of Illinois at Urbana-Champaign
Watch John Stone, present how he achieved over a 3x performance increase in VMD; a popular tool for analyzing large biomolecular systems.
Related Media
The 2019.6 release aims to provide a more detailed data collection, exploration, and collection control for all markets ranging from high performance computing to visual effects. 2019.6 introduces new data sources, improved visual data navigation, expanded CLI capabilities, extended export coverage and statistics.
NVIDIA Nsight Systems 2020.1 release adds CLI support for Power9 architecture. The ability to run multiple recording sessions simultaneously in CLI. UX improvements and stats export options in the GUI and CLI.
In the 2020.3 release, Nsight Systems adds ability to analyze applications parallelized using OpenMP.
In the 2019.3 release, Nsight Systems adds the ability to analyze reports using statistics to identify opportunities for improving your GPU-accelerated application.
The 2019.4 release aims to provide a more detailed data collection, exploration, and collection control for all markets ranging from high performance computing to visual effects. 2019.4 introduces new data sources, improved visual data navigation, expanded CLI capabilities, extended export coverage and statistics.
In the 2019.3 release, Nsight Systems adds the ability to trace vulkan on Windows and Linux targets; allowing you to inspect the CPU/GPU relationship and solve complicated frame stuttering issues in your Vulkan application.
Watch John Stone, of the NIH Center for Macromolecular Modeling and Bioinformatics at University of Illinois at Urbana-Champaign, discuss how he achieved over a 3x performance increase of VMD, a popular tool for analyzing large biomolecular systems.
In the drone industry, the weight and size of the main board is critical. With the ZED stereo camera by Stereolabs, developers can capture the world in 3D and map 3D models of indoor and outdoor scenes up to 20 meters. The small form factor of the Jetson TX1 enables Stereolabs to bring advanced computer vision capabilities to smaller and smaller systems. See what is possible when these two technologies come together in drones to power the latest virtual reality applications.
An introduction to the latest NVIDIA System Profiler. Includes an UI workthrough and setup details for NVIDIA System Profiler on the NVIDIA Jetson Embedded Platform. Download and learn more here.
NVIDIA Nsight Systems now includes support for tracing NCCL (NVIDIA Collective Communications Library) usage in your CUDA application. Download and learn more here.
NVIDIA® Nsight™ Systems is an indispensable system-wide performance analysis tool, designed to help developers tune and scale software across CPUs and GPUs. Download and learn more here.