Новая технология от NVIDIA, Nsight
Недавно я обращал внимание читателей сайта к новой технологии NVIDIA, OpenACC, создав тему о ней. Теперь я создаю ещё одну тему, о Nsight.
Разрабатывайте для GPU в любимой вами интегрированной среде для разработки
Испытайте, насколько просто разрабатывать код для GPU, используя NVIDIA® Nsight™ Visual Studio Edition для Windows или Nsight™ Eclipse Edition для Linux и Mac OS.
Ещё одна новая технология от NVIDIA, Maximus:
Рабочие станции на основе технологии NVIDIA Maximus объединяют возможности визуализации и интерактивного проектирования графических процессоров NVIDIA Quadro® с высокопроизводительной вычислительной мощностью графических процессоров NVIDIA Tesla® на одной рабочей станции. Копроцессоры Tesla автоматически берут на себя выполнение фотореалистичного рендеринга или вычислений для инженерного моделирования. Это снимает нагрузку с ресурсов CPU для работы, для выполнения которой они больше всего подходят: ввод-вывод данных, запуск операционной системы и многозадачность, позволяя при этом графическому процессору Quadro осуществлять требующее высокой производительности интерактивное проектирование.
Конструкторы и инженеры теперь могут одновременно осуществлять автоматизированное конструирование, рендеринг или структурный анализ жидких тел на той же системе, которая используется для проектирования. А профессионалы по созданию контента могут быстрее редактировать видео, создавать эффекты и анимацию.
ВЫБЕРИТЕ СФЕРУ, ЧТО УЗНАТЬ КАК ТЕХНОЛОГИЯ MAXIMUS МОЖЕТ ПОМОЧЬ УСКОРИТЬ РАБОЧИЙ ПРОЦЕСС
Индустрия масс-медиа и развлечений
NVIDIA Nsight Integration
NVIDIA Nsight Integration (highlighted) under the Nsight menu
NVIDIA Nsight Developer Tools Integration for Visual Studio
NVIDIA Nsight Integration is a Visual Studio extension that allows you to access the power of the following NVIDIA Nsight standalone tools from within Visual Studio.
Revision History | Documentation
NVIDIA Nsight Integration is freely offered through the Microsoft Visual Studio Marketplace
Key Features
[1] As of Nsight™ Visual Studio Edition 2020.2, released in September 2020, VS2015 support has been deprecated and will be removed in an upcoming release.
Gallery
Visual Studio project settings are transferred to the Nsight standalone tool
Key binding support for quick access
Enable/Disable tools to control visibility in Nsight menu
NVIDIA Developer Tools Overview
NVIDIA Developer Tools are a collection of applications, spanning desktop and mobile targets, which enable developers to build, debug, profile, and develop class-leading and cutting-edge software that utilizes the latest visual computing hardware from NVIDIA.
Figure 1. Flowchart describing working with new NVIDIA Nsight tools for performance optimization
NVIDIA® Nsight™ for desktop targets
Nsight Deep Learning Designer
NVIDIA® Nsight™ Deep Learning (DL) Designer is an integrated development environment that helps developers efficiently design and develop deep neural networks for in-app inference.
Nsight Systems
All developers should start with Nsight Systems to identify the largest optimization opportunities. Nsight Systems provides developers a system-wide visualization of an applications performance. Developers can optimize bottlenecks to scale efficiently across any number or size of CPUs and GPUs; from large servers to our smallest SoC. For further optimizations to compute kernels developers should use Nsight Compute or to further optimize a graphics workloads, use Nsight Graphics.
Nsight Compute
Nsight Compute is an interactive kernel profiler for CUDA applications. It provides detailed performance metrics and API debugging via a user interface and command line tool. Nsight Compute also provides customizable and data-driven user interface and metric collection that can be extended with analysis scripts for post-processing results.
Nsight Graphics
Nsight Graphics is a standalone application for the debugging, profiling, and analysis of graphics applications on Microsoft Windows and Linux. It allows you to optimize the performance of your Direct3D 11, Direct3D 12, DirectX Raytracing 1.1, OpenGL, Vulkan, and KHR Vulkan Ray Tracing Extension based applications.
Other Utilities
NVIDIA® Nsight™ Visual Studio Edition
An application development environment for heterogeneous platforms which brings GPU computing into Microsoft Visual Studio. NVIDIA Nsight™ VSE allows you to build and debug integrated GPU kernels and native CPU code as well as inspect the state of the GPU and memory.
NVIDIA® Nsight™ Eclipse Edition
NVIDIA® Nsight™ Eclipse Edition is a full-featured IDE powered by the Eclipse platform that provides an all-in-one integrated environment to edit, build, debug, and profile CUDA-C applications. Nsight Eclipse Edition supports a rich set of commercial and free plugins.
NVIDIA® Nsight™ Visual Studio Code Edition
NVIDIA Nsight™ Visual Studio Code Edition (VSCE) is an application development environment for heterogeneous platforms that brings CUDA® development for GPUs into Microsoft Visual Studio Code. NVIDIA Nsight VSCE enables you to build and debug GPU kernels and native CPU code as well as inspect the state of the GPU and memory.
SDKs and APIs
Nsight Perf SDK
The NVIDIA® Nsight™ Perf SDK is a graphics profiling toolbox for DirectX, Vulkan, and OpenGL, enabling you to collect GPU performance metrics directly from your application.
NVIDIA CUDA Profiling Tools Interface (CUPTI)
CUPTI is a dynamic library that enables the creation of profiling and tracing tools that target CUDA applications. Using the CUPTI APIs, independent software developers can create profiling tools that give insight into the CPU and GPU behavior of CUDA applications.
Nsight Aftermath SDK
NVIDIA® Nsight™ Aftermath SDK is a simple library you integrate into your DirectX 12 game’s crash reporter to generate GPU «mini-dumps» when a TDR or exception occurs.
Nsight for Android & Tegra mobile targets
NVIDIA® Nsight™ Tegra, Visual Studio Edition
Nsight Tegra, Visual Studio Edition brings the raw development power and efficiency of Microsoft Visual Studio to Android, enabling developers with project management, compilation, and integrated debugging tools to streamline Android development.
Android Manifest Validator
The Android Manifest Validator is a tool that helps developers verify that APK files maintain conformance to a configurable set of rules. Setting the rules properly can help maximize searchability in the Google Play store.
CodeWorks for Android
CodeWorks for Android installs all software tools required to develop for Android and reduces the complex process of configuring an Android development system down to a single click. With class leading native application development tools for Android, CodeWorks for Android is a professional grade solution designed to provide the best development platform not only for Tegra powered devices but also for all Android devices. Available for Windows, OSX, Ubuntu Linux 32-bit, and Ubuntu Linux 64-bit platforms.
Tegra Graphics Debugger
Tegra Graphics Debugger is a console-grade tool that allows developers to debug and profile Vulkan 1.0, OpenGL 4.3-4.5, and OpenGL ES 2.0-3.1 APIs, enabling developers to get the most out of their Tegra-powered device.
For Windows and Linux graphics debugging, please refer to Nsight Graphics
NVIDIA Nsight Systems
NVIDIA® Nsight™ Systems is a system-wide performance analysis tool designed to visualize an application’s algorithms, help you identify the largest opportunities to optimize, and tune to scale efficiently across any quantity or size of CPUs and GPUs; from large server to our smallest SoC.
Overview
NVIDIA Nsight Systems is a low overhead performance analysis tool designed to provide nsights developers need to optimize their software. Unbiased activity data is visualized within the tool to help users investigate bottlenecks, avoid inferring false-positives, and pursue optimizations with higher probability of performance gains. Users will be able to identify issues, such as GPU starvation, unnecessary GPU synchronization, insufficient CPU parallelizing, and even unexpectedly expensive algorithms across the CPUs and GPUs of their target platform. It is designed to scale across a wide range of NVIDIA platforms such as: large Tesla multi-GPU x86 servers, Quadro workstations, Optimus enabled laptops, DRIVE devices with Tegra+dGPU multi-OS, and Jetson. NVIDIA Nsight Systems can even provide valuable insight into the behaviors and load of deep learning frameworks such as PyTorch and TensorFlow; allowing users to tune their models and parameters to increase overall single or multi-GPU utilization.
Platforms
Learn about Nsight Systems on your platform:
Release Highlights
Downloads
Available for profiling directly on Linux workstations and servers, including the NVIDIA DGX line, or remotely from a variety of hosts: Windows, Linux, or MacOSX.
Documentation
Support
To provide feedback, request additional features, or report support issues, please use the Developer Forums.
System Requirements
Supported target operating systems for data collection:
Supported target hardware
Supported target software
Supported host operating systems for data visualization:
Release Highlights
Downloads
Available for profiling directly on Linux workstations and servers, including the NVIDIA DGX line, or remotely from a variety of hosts: Windows, Linux, or MacOSX.
Visual Studio Integration*requires Nsights Sytems to be installed
Documentation
Support
To provide feedback, request additional features, or report support issues, please use the Developer Forums.
System Requirements
Supported operating systems
Supported target hardware
Supported target software
Release Highlights
2019.4
2019.3
Downloads
Nsight Systems is bundled as part of the following product development suites:
Documentation
Support
To provide feedback, request additional features, or report support issues, please use the Developer Forums.
System Requirements
Supported Target Hardware
Supported target operating systems for data collection:
Supported host operating systems for data visualization:
Features
Learn about feature support per target platform group
| Feature | Linux Workstations and Servers | Windows Workstations and Gaming PCs | Jetson Autonomous Machines | DRIVE Autonomous Vehicles |
|---|---|---|---|---|
| View system-wide application behavior across CPUs and GPUs | ||||
| CPU cores utilization, process, & thread activities | yes | yes | yes | yes |
| CPU thread periodic sampling backtraces | yes* | no | yes | yes |
| CPU thread blocked state backtraces | yes** | yes | yes | yes |
| CPU performance counter sampling | no | no | yes | yes |
| GPU workload trace | yes | yes | yes | yes |
| GPU context switch trace | no | no | yes | yes |
| SOC hypervisor trace | — | — | — | yes |
| SOC memory bandwidth sampling | — | — | yes | yes |
| SOC Accelerators trace | — | — | Xavier | Xavier |
| OS Event Trace | ftrace | ETW | ftrace | ftrace |
| Investigate CPU-GPU interactions and bubbles | ||||
| User annotations API trace NVIDIA Tools Extension API (NVTX) | yes | yes | yes | yes |
| CUDA API | yes | yes | yes | yes |
| CUDA libraries trace (cuBLAS, cuDNN & TensorRT) | yes | no | yes | yes |
| OpenGL API trace | yes | yes | yes | yes |
| Vulkan API trace | yes | yes | no | no |
| Direct3D12, Direct3D11, DXR, & PIX APIs | — | yes | — | — |
| OptiX | 7.1+ | 7.1+ | — | — |
| Bidirectional correlation of API and GPU workload | yes | yes | yes | yes |
| Identify GPU idle and sparse usage | yes | yes | yes | yes | Multi-GPU Graphics trace | — | Direct3D12 | — | — |
| Ready for big data | ||||
| Fast GUI capable of visualizing in excess of 10 million events on laptops | yes | yes | yes | yes |
| Additional command line collection tool | yes | no | no | no |
| NV-Docker container support | yes | — | — | — |
| NVIDIA GPU Cloud support | yes | — | — | — |
| Minimum user privilege level | user | administrator | root | root |
* On Intel Haswell and newer CPU architecture
** Only with OS runtime trace enabled. Some syscalls such as handcrafted assembly may be missed. Backtraces may only appear if time threasholds are exceeded.
What Users Are Saying
Tracxpoint
We noticed that our new Quadro P6000 server was ‘starved’ during training and we needed experts for supporting us. NVIDIA Nsight Systems helped us to achieve over 90 percent GPU utilization. A deep learning model that previously took 600 minutes to train, now takes only 90.
Felix Goldberg, Chief AI Scientist, Tracepoint
NVIDIA
I used Nsight Systems to analyze our internal system and built a plan for optimizing both CPU and GPU usage, with significant performance and resource gains ultimately achieved to both. Overall, there is no alternative tool like Nsight which helps me to extract only, and exactly what I need to understand resource usage.
Sang Hun Lee, System Software Engineer, NVIDIA
NIH Center for Macromolecular Modeling and Bioinformatics at University of Illinois at Urbana-Champaign
Watch John Stone, present how he achieved over a 3x performance increase in VMD; a popular tool for analyzing large biomolecular systems.
Related Media
The 2019.6 release aims to provide a more detailed data collection, exploration, and collection control for all markets ranging from high performance computing to visual effects. 2019.6 introduces new data sources, improved visual data navigation, expanded CLI capabilities, extended export coverage and statistics.
NVIDIA Nsight Systems 2020.1 release adds CLI support for Power9 architecture. The ability to run multiple recording sessions simultaneously in CLI. UX improvements and stats export options in the GUI and CLI.
In the 2020.3 release, Nsight Systems adds ability to analyze applications parallelized using OpenMP.
In the 2019.3 release, Nsight Systems adds the ability to analyze reports using statistics to identify opportunities for improving your GPU-accelerated application.
The 2019.4 release aims to provide a more detailed data collection, exploration, and collection control for all markets ranging from high performance computing to visual effects. 2019.4 introduces new data sources, improved visual data navigation, expanded CLI capabilities, extended export coverage and statistics.
In the 2019.3 release, Nsight Systems adds the ability to trace vulkan on Windows and Linux targets; allowing you to inspect the CPU/GPU relationship and solve complicated frame stuttering issues in your Vulkan application.
Watch John Stone, of the NIH Center for Macromolecular Modeling and Bioinformatics at University of Illinois at Urbana-Champaign, discuss how he achieved over a 3x performance increase of VMD, a popular tool for analyzing large biomolecular systems.
In the drone industry, the weight and size of the main board is critical. With the ZED stereo camera by Stereolabs, developers can capture the world in 3D and map 3D models of indoor and outdoor scenes up to 20 meters. The small form factor of the Jetson TX1 enables Stereolabs to bring advanced computer vision capabilities to smaller and smaller systems. See what is possible when these two technologies come together in drones to power the latest virtual reality applications.
An introduction to the latest NVIDIA System Profiler. Includes an UI workthrough and setup details for NVIDIA System Profiler on the NVIDIA Jetson Embedded Platform. Download and learn more here.
NVIDIA Nsight Systems now includes support for tracing NCCL (NVIDIA Collective Communications Library) usage in your CUDA application. Download and learn more here.
NVIDIA® Nsight™ Systems is an indispensable system-wide performance analysis tool, designed to help developers tune and scale software across CPUs and GPUs. Download and learn more here.
NVIDIA Nsight Graphics
NVIDIA® Nsight™ Graphics is a standalone developer tool that enables you to debug, profile, and export frames built with Direct3D (11, 12, DXR), Vulkan (1.2, NV Vulkan Ray Tracing Extension), OpenGL, OpenVR, and the Oculus SDK.
Version 2021.5 Release Notes | Revision History
NVIDIA® Nsight™ Graphics is freely offered through the NVIDIA Registered Developer Program
Range-Based GPU Profiling
GPU Trace
Nsight Aftermath
Ray Tracing Debugging
C++ Capture Export
Pixel History
Images of Hellblade™: Senua’s Sacrifice courtesy of Ninja Theory Ltd.; Hellblade is a Direct3D 11 game based on Unreal Engine 4
What People Are Saying
«Dassault Systèmes and its SOLIDWORKS brand have always supported bleeding edge rendering technologies from NVIDIA. Nsight Graphics is one of our go-to graphics debugging tools. With valuable features like C++ Capture and Pixel History, Nsight Graphics has enabled us to solve complex rendering problems with ease.»
—Siddharth PALANIAPPAN, SOLIDWORKS Graphics R&D Development Senior Manager, Dassault Systèmes
