1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289
|
// Copyright 2024 The Chromium Authors
// Use of this source code is governed by a BSD-style license that can be
// found in the LICENSE file.
#ifndef COMPONENTS_INPUT_RENDER_WIDGET_HOST_VIEW_INPUT_H_
#define COMPONENTS_INPUT_RENDER_WIDGET_HOST_VIEW_INPUT_H_
#include <memory>
#include <optional>
#include <string>
#include "base/component_export.h"
#include "base/observer_list.h"
#include "components/input/event_with_latency_info.h"
#include "components/input/render_input_router.h"
#include "components/viz/common/hit_test/aggregated_hit_test_region.h"
#include "components/viz/common/hit_test/hit_test_data_provider.h"
#include "components/viz/common/surfaces/surface_id.h"
#include "third_party/blink/public/mojom/input/input_event_result.mojom-shared.h"
#include "third_party/blink/public/mojom/page/widget.mojom-shared.h"
#include "ui/events/event.h"
namespace blink {
class WebMouseEvent;
class WebMouseWheelEvent;
} // namespace blink
namespace ui {
class Cursor;
class LatencyInfo;
} // namespace ui
namespace input {
class CursorManager;
class RenderInputRouter;
class RenderWidgetHostViewInputObserver;
// RenderWidgetHostViewInput is an interface implemented by an object that acts
// as the "View" portion of a RenderWidgetHost. This interface acts as a helper
// for receiving input events from the surrounding environment and forwarding
// them to the RenderWidgetHost, allowing breaking dependency on RWHV and RWHI
// for input handling including targeting and dispatching. This interface would
// assist VizCompositor Thread to implement input handling in the future with
// InputVizard.
// (https://docs.google.com/document/d/1mcydbkgFCO_TT9NuFE962L8PLJWT2XOfXUAPO88VuKE)
//
// The lifetime of RenderWidgetHostViewInput is tied to the lifetime of the
// renderer process. If the render process dies, the RenderWidgetHostViewInput
// goes away and all references to it must become nullptr.
class COMPONENT_EXPORT(INPUT) RenderWidgetHostViewInput
: public StylusInterface {
public:
virtual base::WeakPtr<RenderWidgetHostViewInput> GetInputWeakPtr() = 0;
virtual float GetDeviceScaleFactor() const = 0;
// Returns true if the mouse pointer is currently locked.
virtual bool IsPointerLocked() = 0;
virtual RenderInputRouter* GetViewRenderInputRouter() = 0;
virtual void ProcessTouchEvent(const blink::WebTouchEvent& event,
const ui::LatencyInfo& latency) = 0;
virtual void ProcessMouseEvent(const blink::WebMouseEvent& event,
const ui::LatencyInfo& latency) = 0;
virtual void ProcessMouseWheelEvent(const blink::WebMouseWheelEvent& event,
const ui::LatencyInfo& latency) = 0;
virtual void ProcessGestureEvent(const blink::WebGestureEvent& event,
const ui::LatencyInfo& latency) = 0;
// Because the associated remote WebKit instance can asynchronously
// prevent-default on a dispatched touch event, the touch events are queued in
// the GestureRecognizer until invocation of ProcessAckedTouchEvent releases
// it to be consumed (when |ack_result| is NOT_CONSUMED OR NO_CONSUMER_EXISTS)
// or ignored (when |ack_result| is CONSUMED).
// |touch|'s coordinates are in the coordinate space of the view to which it
// was targeted.
virtual void ProcessAckedTouchEvent(
const TouchEventWithLatencyInfo& touch,
blink::mojom::InputEventResultState ack_result);
virtual void DidStopFlinging() {}
// Returns the root-view associated with this view. For derived views that are
// not embeddable, this method always returns a RenderWidgetHostViewBase
// instance.
virtual RenderWidgetHostViewInput* GetRootView() = 0;
// Obtains the root window FrameSinkId.
virtual viz::FrameSinkId GetRootFrameSinkId();
// Returns the ID associated with the CompositorFrameSink of this view.
virtual const viz::FrameSinkId& GetFrameSinkId() const = 0;
// Returns the LocalSurfaceId allocated by the parent client for this view.
virtual const viz::LocalSurfaceId& GetLocalSurfaceId() const = 0;
// Returns the SurfaceId currently in use by the renderer to submit compositor
// frames.
virtual viz::SurfaceId GetCurrentSurfaceId() const = 0;
// Called whenever the browser receives updated hit test data from viz.
virtual void NotifyHitTestRegionUpdated(
const viz::AggregatedHitTestRegion& region) {}
// Indicates whether the widget has resized or moved within its embedding
// page during a feature-parameter-determined time interval.
virtual bool ScreenRectIsUnstableFor(const blink::WebInputEvent& event);
// See kTargetFrameMovedRecentlyForIOv2 in web_input_event.h.
virtual bool ScreenRectIsUnstableForIOv2For(
const blink::WebInputEvent& event);
virtual void PreProcessTouchEvent(const blink::WebTouchEvent& event) {}
virtual void PreProcessMouseEvent(const blink::WebMouseEvent& event) {}
// Coordinate points received from a renderer process need to be transformed
// to the top-level frame's coordinate space. For coordinates received from
// the top-level frame's renderer this is a no-op as they are already
// properly transformed; however, coordinates received from an out-of-process
// iframe renderer process require transformation.
virtual gfx::PointF TransformPointToRootCoordSpaceF(
const gfx::PointF& point) const;
// Converts a point in the root view's coordinate space to the coordinate
// space of whichever view is used to call this method.
virtual gfx::PointF TransformRootPointToViewCoordSpace(
const gfx::PointF& point);
// Transform a point that is in the coordinate space of a Surface that is
// embedded within the RenderWidgetHostViewInput's Surface to the
// coordinate space of an embedding, or embedded, Surface. Typically this
// means that a point was received from an out-of-process iframe's
// RenderWidget and needs to be translated to viewport coordinates for the
// root RWHV, in which case this method is called on the root RWHV with the
// out-of-process iframe's SurfaceId.
// Returns false when this attempts to transform a point between coordinate
// spaces of surfaces where one does not contain the other. To transform
// between sibling surfaces, the point must be transformed to the root's
// coordinate space as an intermediate step.
virtual bool TransformPointToLocalCoordSpace(
const gfx::PointF& point,
const viz::FrameSinkId& original_frame_sink_id,
gfx::PointF* transformed_point);
// Given a RenderWidgetHostViewInput that renders to a Surface that is
// contained within this class' Surface, find the relative transform between
// the Surfaces and apply it to a point. Returns false if a Surface has not
// yet been created or if |target_view| is not a descendant RWHV from our
// client.
virtual bool TransformPointToCoordSpaceForView(
const gfx::PointF& point,
RenderWidgetHostViewInput* target_view,
gfx::PointF* transformed_point);
// On success, returns true and modifies |*transform| to represent the
// transformation mapping a point in the coordinate space of this view
// into the coordinate space of the target view.
// On Failure, returns false, and leaves |*transform| unchanged.
// This function will fail if viz hit testing is not enabled, or if either
// this view or the target view has no current FrameSinkId. The latter may
// happen if either view is not currently visible in the viewport.
// This function is useful if there are multiple points to transform between
// the same two views. |target_view| must be non-null.
virtual bool GetTransformToViewCoordSpace(
RenderWidgetHostViewInput* target_view,
gfx::Transform* transform);
// Transforms |point| to be in the coordinate space of browser compositor's
// surface. This is in DIP.
virtual void TransformPointToRootSurface(gfx::PointF* point);
// Retrieves the size of the viewport for the visible region in DIP. May be
// smaller than the view size if a portion of the view is obstructed (e.g. by
// a virtual keyboard).
virtual gfx::Size GetVisibleViewportSize() = 0;
// Returns the view into which this view is directly embedded. This can
// return nullptr when this view's associated child frame is not connected
// to the frame tree or when view is the root view.
virtual RenderWidgetHostViewInput* GetParentViewInput();
// Called prior to forwarding input event messages to the renderer, giving
// the view a chance to perform in-process event filtering or processing.
// Return values of |NOT_CONSUMED| or |UNKNOWN| will result in |input_event|
// being forwarded.
virtual blink::mojom::InputEventResultState FilterInputEvent(
const blink::WebInputEvent& input_event);
virtual void GestureEventAck(const blink::WebGestureEvent& event,
blink::mojom::InputEventResultSource ack_source,
blink::mojom::InputEventResultState ack_result);
virtual void WheelEventAck(const blink::WebMouseWheelEvent& event,
blink::mojom::InputEventResultState ack_result);
virtual void ChildDidAckGestureEvent(
const blink::WebGestureEvent& event,
blink::mojom::InputEventResultState ack_result);
virtual void SetLastPointerType(ui::EventPointerType last_pointer_type) {}
// Sets the cursor for this view to the one specified.
virtual void UpdateCursor(const ui::Cursor& cursor) = 0;
// Changes the cursor that is displayed on screen. This may or may not match
// the current cursor's view which was set by UpdateCursor.
virtual void DisplayCursor(const ui::Cursor& cursor);
// Views that manage cursors for window return a CursorManager. Other views
// return nullptr.
virtual CursorManager* GetCursorManager();
// Calls UpdateTooltip if the view is under the cursor.
virtual void UpdateTooltipUnderCursor(const std::u16string& tooltip_text) {}
// Updates the tooltip text and displays the requested tooltip on the screen.
// An empty string will clear a visible tooltip.
virtual void UpdateTooltip(const std::u16string& tooltip_text) {}
// If mouse wheels can only specify the number of ticks of some static
// multiplier constant, this method returns that constant (in DIPs). If mouse
// wheels can specify an arbitrary delta this returns 0.
virtual int GetMouseWheelMinimumGranularity() const;
// Initiate stylus handwriting.
virtual void OnStartStylusWriting() {}
// This is called after the renderer attempts to focus content eligible for
// handwriting via mojom::blink::FrameWidget::OnStartStylusWriting. If content
// eligible for stylus handwriting has focus, then `focus_result` will be set,
// otherwise it will be nullptr.
virtual void OnEditElementFocusedForStylusWriting(
blink::mojom::StylusWritingFocusResultPtr focus_result) {}
virtual void OnAutoscrollStart() = 0;
// Add and remove observers for lifetime event notifications. The order in
// which notifications are sent to observers is undefined. Clients must be
// sure to remove the observer before they go away.
virtual void AddObserver(RenderWidgetHostViewInputObserver* observer);
virtual void RemoveObserver(RenderWidgetHostViewInputObserver* observer);
virtual const viz::DisplayHitTestQueryMap& GetDisplayHitTestQuery() const = 0;
// Stops flinging if a GSU event with momentum phase is sent to the renderer
// but not consumed.
virtual void StopFlingingIfNecessary(
const blink::WebGestureEvent& event,
blink::mojom::InputEventResultState ack_result);
protected:
RenderWidgetHostViewInput();
~RenderWidgetHostViewInput() override;
virtual void UpdateFrameSinkIdRegistration() = 0;
// If |event| is a touchpad pinch or double tap event for which we've sent a
// synthetic wheel event, forward the |event| to the renderer, subject to
// |ack_result| which is the ACK result of the synthetic wheel.
virtual void ForwardTouchpadZoomEventIfNecessary(
const blink::WebGestureEvent& event,
blink::mojom::InputEventResultState ack_result);
void NotifyObserversAboutShutdown();
void StopFling();
bool view_stopped_flinging_for_test() const {
return view_stopped_flinging_for_test_;
}
private:
// Transforms |point| from |original_view| coord space to |target_view| coord
// space. Result is stored in |transformed_point|. Returns true if the
// transform is successful, false otherwise.
bool TransformPointToTargetCoordSpace(
RenderWidgetHostViewInput* original_view,
RenderWidgetHostViewInput* target_view,
const gfx::PointF& point,
gfx::PointF* transformed_point) const;
// True when StopFlingingIfNecessary() calls StopFling().
bool view_stopped_flinging_for_test_ = false;
base::ObserverList<RenderWidgetHostViewInputObserver>::Unchecked observers_;
std::optional<blink::WebGestureEvent> pending_touchpad_pinch_begin_;
};
} // namespace input
#endif // COMPONENTS_INPUT_RENDER_WIDGET_HOST_VIEW_INPUT_H_
|