What is PyTorch? Inside torch.matmulPyTorch 到底是什么?跟踪一次 torch.matmul
A matrix multiplication selects an implementation for its device and, when gradients are needed, records dependencies for the backward pass.一次矩阵乘法先选择设备上的实现;需要求导时,还会记录依赖关系,供反向传播使用。
Stay curious. Look closely.保持好奇,认真看世界。
Start with a question or an observation. Make complex ideas clear, and keep the details worth noticing.从具体的问题与观察出发,把复杂的原理讲清楚,把值得留意的细节记录下来。
A matrix multiplication selects an implementation for its device and, when gradients are needed, records dependencies for the backward pass.一次矩阵乘法先选择设备上的实现;需要求导时,还会记录依赖关系,供反向传播使用。
The eye forms an image; the retina converts light into electrical responses and processes color and contrast before signals reach the brain.眼睛先成像,视网膜再把光转成电信号;神经回路提取颜色与对比,传向大脑。

From Shantou’s arcades to Nan’ao’s coast, then Chaozhou’s bridge, old streets and lingering flavours.从汕头的骑楼走到南澳的海边,再去潮州看桥、逛街、尝一碟咸鲜。
Submerged branches, reflected clouds and streams through grass: photographs lead back into the small details of Jiuzhaigou’s blue.水底倒木、半山云影、草间细流:沿着几张照片,重看九寨沟青碧深处的细节。
Compilation can fuse compatible operations and avoid intermediate data; later calls reuse the cached code only while its assumptions hold.编译把兼容运算融合,减少中间数据;输入仍满足缓存版本的条件时,后续调用才能复用它。
When several paths depend on one value, backward execution adds their gradient contributions before continuing through the graph.同一个变量沿多条路径影响结果时,反向传播先汇总各路梯度,再向它的上游继续计算。
A CPU call can return before the GPU finishes. Streams order work; synchronization boundaries determine what a timing actually measures.CPU 返回时,GPU 可能还没算完;流确定工作顺序,同步边界决定计时究竟测到了什么。
Derivations, experiments, and moments worth keeping.推导、实验,还有值得留下的片刻。
About Dapeng关于冯大鹏